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(57) A method ana dev*c* tc» »nte* leaving bit stream 
so that a brt stream can t*- s*^rm ess -reproduced from a 
multimedia optical d s> ?M w^cn is used efficiently by 
recording data shared d> a p^auty of titles and has a 
data structure that reaicre^ u^cr*. a new function as the 
multiangle reproductKX* T>>*- aa:a structure is such that 
a plurality ol videc cr> ' containing com- 

pressed video data are reco»^ec the multimedia opti- 
cal disk (M) in the o»oe< o* 'ep-odjcion in interleave 
areas (blocks 4 and 6} anc continuous areas (blocks 1, 
2, 3, 5. and 7) and a mdndyt^em are (NV) in which 
data are interleave-* ecc«c*-d together with the video 
data is provided. The intimation which specifies the 
information on the end portion of the area from which 
data are read out continuous y and the information on 
the position where the data can bo reproduced next on 
the disk are recorded in the management area. 
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Description 
Technical Field 

The present invention relates to a method and apparatus for interleaving a bitstieam tor use in an authoring system 
for variously processing a data bilstream compr ising the video data, audio data, and sub-picture data constituting each 
of plural program titles containing i elated video data, audio data, and sub-picture data content to generate a bitstream 
from which a new title containing the content desiied by the user can be leproduced. and efficiently recording and 
reproducing said generated bitstream using a particular recording medium. 

Background Art 

Authoring systems used to produce program titles comprising related video data, audio data, and sub-picture data 
by digitally processing, for example, multimedia data comprising video, audio, and sub-picture data recorded to laser 
disk or video CD foimats aie currently available. 

Systems using Video-CDs in particulai aie able to record video data to a CD format disk, which was originally 
designed with an approximately 600 MB recording capacity for storing digital audio data only, by using such high effi- 
ciency video compression techniques as MPEG. As a result of the increased effective recording capacity achieved 
using data compression techniques, karaoke titles and other conventional laser disk applications are gradually being 
transferred to the video CD format. 

Users today expect both sophisticated title content and high reproduction quality. To meet these expectations, each 
title must be composed from bitstreams with an increasingly deep hierarchical structure. The data size of multimedia 
titles written with bitstreams having such deep hierarchical structures, however, is ten or more times greater than the 
data size of less complex titles. The need to edit small image (title) details also makes it necessary to process and con- 
trol the bitstream using low order hierarchical data units. 

It is therefore necessary to develop and prove a bitstream structure and an advanced digital processing method 
including both recording and reproduction capabilities whereby a large volume, multiple level hierarchical digital bit- 
stream can be efficiently controlled at each level of the hierarchy. Also needed are an apparatus for executing this digital 
processing method, and a recording media to which the bitstream digitally processed by said apparatus can be effi- 
ciently recorded for storage and from which said recorded information can be quickly reproduced. 

Means of increasing the storage capacity of conventional optical disks have been widely researched to address the 
recording medium aspect of this problem. One way to increase the storage capacity of the optical disk is to reduce the 
spot diameter D of the optical (laser) beam. If the wavelength of the laser beam is I and the aperture of the objective 
lens is NA, then the spot diameter D is proportional to l/NA, and the storage capacity can be efficiently improved by 
decreasing I and increasing NA. 

As described, for example, in United States Patent 5,235,581, however, coma caused by a relative tilt between the 
disk surface and the optical axis of the laser beam (hereafter "tilt") increases when a large aperture (high NA) lens is 
used. To prevent tilt-induced coma, the transparent substrate must be made very thin. The problem is that the mechan- 
ical strength of the disk is low when the transparent substrate is very thin. 

MPEGi. the conventional method of recording and reproducing video, audio, and graphic signal data, has also 
been replaced by the more robust MPEG2 method, which can transfer large data volumes at a higher rate. It should be 
noted that the compression method and data format of the MPEG2 standard differ somewhat from those of MPEGi. 
The specif ic content of and differences between MPEGi and MPEG2 are described in detail in the ISO-1 1172 and ISO- 
13818 MPEG standards, and further description thereof is omitted below. 

Note, however, that while the structure of the encoded video stream is defined in the MPEG2 specification, the hier- 
archical structure of the system stream and the method of processing lower hierarchical levels are not defined. 

As described above, it is therefore not possible in a conventional authoring system to process a large data stream 
containing sufficient information to satisfy many different user requirements. Moreover, even if such a processing 
method were available, the processed data recorded thereto cannot be repeatedly used to reduce data redundancy 
because there is no large capacity recording medium currently available that can efficiently record and reproduce high 
volume bitstreams such as described above. 

More specifically, particular significant hardware and software requirements must be satisfied in order to process a 
bitstream using a data unit smaller than the title. These specific hardware requirements include significantly increasing 
the storage capacity of the recording medium and increasing the speed of digital processing; software requirements 
include inventing an advanced digital processing method including a sophisticated data structure. 

Therefore, the object of the present invention is to provide an effective authoring system for controlling a multimedia 
data bitstream with advanced hardware and software requirements using a data unit smaller than the title to better 
address advanced user requirements. 
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y To share data between plural titles and ther eby efliciently utilize optical disk capacity, multi-scene control whereby 

scene data common to plural titles and the desiied scenes on the same time-base from within multi-scene periods con- 
taining plural scenes unique to particulai reproduction paths can be freely selected and reproduced is desirable. 

However, when plural scenes unique to a reproduction path within the multi-scene period are arranged on the same 
5 time-base, the scene data must be contiguous. Unselected multi-scene data is therefore unavoidably inserted between 
the selected common scene data and the selected multi-scene data. The problem this creates when reproducing multi- 
scene data is that r eproduction is inter rupted by this unselected scene data. 

The object of the present invention is theretore to provide a data structure enabling discrete scene data to be seam- 
lessly reproduced, i.e.. without inter mittence in the data presentation, even when reproducing such multi-scene data; a 
w method for generating a system str eam having said data str ucture; a r ecording apparatus and a reproduction apparatus 
lor recording and reproducing said system stream; and a medium to which said system stream can be reproduced and 
from which said system stream can be reproduced by said recording apparatus and reproduction apparatus. 

A further problem can be expected when the multi-scene data is multi-angle scene data, i.e., scene data showing 
substantially the same subject from different angles. In the case of a live sports broadcast, this mufti-angle scene data 
75 may be obtained by recording a baseball batter, for example, with cameras in different locations. The problem is thus 
that when the user selects one of these plural angle scenes during data piesentation. data from different angles is con- 
nected where the angle changes, and a natural, seamless presentation cannot be expected. 

Therefore, the object of the present invention is to provide a data structure whereby natural, seamless reproduction 
without scene data inter mitting can be achieved even in such multi-angle scene periods; a method for generating a sys- 
20 tern stream having said data structure; a recording apparatus and a reproduction apparatus for recording and reproduc- 
ing said system stream; and a medium to which said system stream can be recorded and from which said system 
stream can be reproduced by said recording apparatus and reproduction apparatus. 

The present application is based upon Japanese Patent Application No. 7-252734. which was filed on September 
29. 1995. the entire contents of which are expressly incorporated by reference herein 

25 

Disclosure of Invention 



In order to achieve the aforementioned objective, an interleaving method tor generating a bitstream from plural 
video objects containing compressed video data by arranging in the presentation order, wherein interleaved data blocks 

so in which plural video objects are contiguously arrayed using interleaved units each longer than the shortest read time 
ILVUMT such that the video object presentation start and end points are aligned, the ratio between the presentation 
times of video objects with the shortest presentation time and video objects other than those with the shortest presen- 
tation time is within a range obtained from the shortest read time ILVUMT, the maximum jumpable distance JM, and the 
smallest control unit VOBU, and contiguous data blocks wherein the presentation start points and end points of the 

35 video objects arrayed therein are not aligned. 



Brief Description of Drawings 

Fig. 1 is a graph schematically showing a structure of mufti media bit stream according to the present invention, 
40 Fig. 2 is a block diagram showing an authoring encoder according to the present invention, 

Fig. 3 is a block diagram showing an authoring decoder according to the present invention, 

Fig. 4 is a side view of an optical disk storing the multi media bit stream of Fig. 1 , 

Fig. 5 is an enlarged view showing a portion confined by a circle of Fig. 4, 

Fig. 6 is an enlarged view showing a portion confined by a circle of Fig. 5, 
46 Fig. 7 is a side view showing a variation of the optical disk of Fig. 4, 

Fig. 8 is a side view showing another variation of the optical disk of Fig. 4, 

Fig. 9 is a plan view showing one example of track path formed on the recording surface of the optical disk of Fig. 4, 
Fig. 10 is a plan view showing another example of track path formed on the recording surface of the optical disk of 
Fig. 4, 

so Fig. 1 1 is a diagonal view schematically showing one example of a track path pattern formed on the optical disk of 

Fig. 7, 

Fig. 12 is a plan view showing another example of track path formed on the recording surface of the optical disk of 
Fig. 7, 

Fig. 13 is a diagonal view schematically showing one example of a track path pattern formed on the optical disk of 
es Fig. 8. 

Fig. 14 is a plan view showing another example of track path formed on the recording surface of the optical disk of 
Fig. 8. 

Fig. 15 is a graph showing the audio waves resulting from the audio data recorded to the multi-angle data within 
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multi-angle scene period. 

Fig 16 is a graph schematically showing the stiuclui e of multimedia bit stream for use in Digital Video Disk system 
according to the present invention, 

Frg 1 7 is a graph schematically showing the encoded video stream according to the present invention. 
Fig 18 is a graph schematically showing an internal structure ol a video zone ol Fig. 16 

Fig 19 is a graph schematically showing the stream management information according to the present invention. 
Fig 20 is a graph schematically showing the structure the navigation pack NV of Fig. 17, 

Fig 21 is a graph is assistance ol explaining a concept of parental lock playback control according to the present 
invention. 

Fig 22 is a graph schematically showing the data structure used in a digital video disk system according to the 
present invention. 

Fig 23 is a graph m assistance of explaining a concept of Multi-angle scene control according to the present inven- 
tion. 

Fig 24 is a graph in assistance of explaining a concept of multi scene data connection, 
Fig 25 is a Woe* diagiam showing a DVD encodei according to the present invention. 
Fig 26 is a Woe* a»ay»am showing a DVD decode? according to the present invention. 

Fig 27 is a g»aph schematically showing an encoding information table generated by the encoding system control- 
ler of Fig 25 

Fig 28 is a graph schcrrvit>aaii y showing an encoding information tables. 

Fig 29 is a g*aph schomat>caO y shoeing an encoding parameters used by the video encoder of Fig. 25, 

Fig 30 is a graph tch^-na*c*i»y Ux>*tng an example of the contents of the program chain information according to 

the present invention 

Fig 31 is a graph scrv**~^*c-afi> sreww^g another example of the contents of the program chain information accord- 
ing to the prespr-r inw^rrt*-^ 

Fig 32 is a graph srr>«*^u»-w\^# , ^rrwrng * relationship between the accumulated data quantity in the stream buffer 
and the operating mcx> c tr* 'f^cmg head of Fig. 26. 

Fig. 33 is a graph m a^v^nc* of eipUmng a concept of sharing data between plural titles. 

Ftg 34 is a gracn n assistance of explaining a concept of contiguous reproduction of non -contiguously arranged 
data block. 

Fig 35 is a graph m asvszance of explaining a concept of interleaving process enabling seamless reproduction of 
scenes. 

Fig 36 is a graph also ass*sJance of explaining a concept of interleaving process enabling seamless reproduction 
of scenes. 

Fig. 37 is a graph schema? icaHy snowing an actual arrangement of data blocks recorded to a data recording track 
on a recording med urr according to the present invention. 

Fig. 38 is a graph schemat>cafly snowing contiguous block regions and interleaved block regions array, 

Fig 39 is a graph schemat>cati y showing a content of a VTS title VOBS according to the present invention, 

Fig 40 is a graph schema^caJJy snowing an internal data structure of the interleaved block regions according to the 

present invention. 

Fig. 41 is a graph m assistance of explaining a concept of defining the minimum number of divisions in VOB for 
interleaving. 

Fig. 42 is a graph schtrrvitieafty showing the data structure of the interleaved unit. 

Fig. 43 is a graph in assis:<*fv« of explaining a concept of parental control according to the present invention, 
Fig. 44 is a graph m a^unce of explaining a concept of multi-angle scene control according to the present in 
invention. 

Fig. 45 is a graph m assstanc* of e«ptammg the multi-angle scene control when two multi-angle data having differ- 
ent audio data. 

Fig. 46 is a graph schematically showing plural angle data written to multi-angle scene period according to the 
present invention. 

Fig. 47 is a graph showing the stream containing a multi-angle scene period and the basics of the on<iisk layout 
according to the present invention. 

Fig. 48 is a graph showing ar example in which the last pack address in the current A-ILVU and the address of the 
next A-ILVU are recorded «c* plural angles according to the present invention. 

Figs. 49 and 50 are graphs m assistance of explaining the method of managing addresses on the switching unit 

level between multiple angle data in multi-angle scene periods according to the present invention. 

Fig. 51 is a flow chart, formed by Figs 5i A and 51 B, showing an operation of the DVD encoder of Fig. 25, 

Fig. 52 is a flow chart showing detailed ol the encode parameter production sub-routine of Fig. 51. 

Fig. S3 is a flow chart showing the detailed of the VOB data setting routine of Fig. 52. 
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Fig. 54 is a How chart showing the encode paiameters geneialing operation for a seamless switching. 
Fig. 55 is a flow chart showing the encode parameters generating operation for a system stream. 
Fig. 56 is a flow chart showing the operation of the DVD encodei of Fig. 26. 

Fig. 57 is a flow chart showing details of the multi-angle non-seamless switching control routine of Fig. 56. 
Fig. 58 is a flow chart showing details of the multi-angle seamless switching control routine of Fig. 56. 
Fig. 59 is a flow chart showing details of the parental lock sub-routine of Fig. 56. 
Fig. 60 is a flow chart showing details ol the single scene subroutine of Fig. 56. 

Fig. 61 is a flow chart showing the encode paiameters generating operation tor a system stream containing a single 
scene. 

Figs. 62 and 63 are graphs showing decoding information table produced by the decoding system controller of Fig. 
26. 

Fig. 64 is a flow chart showing details of reproduction extracted PGC routing of Fig. 69. 

Fig. 65 is a flow chart showing details of non-seamless multi-angle decoding process of Fig. 70, 

Fig 66 is a block diagram showing details of the stream buffer of Fig. 26. 

Fig 67 is a flow chart showing details of decoding data piocess of Fig. 64. performed by the stream bufler. is 
shown. 

Fig 68 is a flow chart showing details of the decoder synchronization process of Fig. 67. 
Fig 69 is a flow chart showing the operation of the DVD decoder DCD of Fig. 26. 

F»g 70 »o a flow chat showing details of the stream buffer data transfer process according to the present invention. 
F ig 7i ic a flow chart showing details of the non multi-angle decoding process of Fig. 70. 
F »g 7? is. a tk>* chart showing details of the non-multi-angled interleave process of Fig. 71 , 

* «g 7j 4 flow chart showing details of the non-multi-angled contiguous block process, 

* *5 ?4 ^ 4 tv^ chart showing details of the non-multi-angle decoding process of Fig. 70. 

r i*. a chart showing details of the seamless multi-angle decoding process of Fig. 70. 

r *m 7? a f «> graphs in assistance of explaining the switching between scene angles within a multi-angle 

vc QC2 

* ^ * 3 ^ assistance of explaining a method for achieving the data structure shown in Fig. 46. 

1 * • * ^ *" assistance of explaining a method for actually setting the audio data presentation times on the 
irvi«*.- ar^jmf -^ticrung unit level to the same value in different angles, and 

» s„ 4 j * r- m assistance of explaining the multi-angle scene period data structure in which common audio 
ca'^ *- h «*acm different angle according to the present invention. 

6*-%? kajv v Out the Invention 

; *^*^!t rv^on s cetailedly described with reference to the accompanying drawings. 

P<*:a *v srs k t* ~~ ajro mq system 

in- o^. vt: jOj*^ o* the multimedia data bitstream processed using the recording apparatus, recording medium, 
ret* oaocior «>ara-uu and authoring system according to the present invention is described first below with reference 
to f «g • 

i-i «,t! uctu v trie refers to the combination of video and audio data expressing program content recognized 
b> «« iOlk^ikp^ fi'teiiamment. or other purpose. Referenced to a motion picture (movie), one title may corre- 

spond to rrwr content o» an entii e movie, or to just one scene within said movie. 

A *>deo tit e sei • VI Z) comprises the bitstream data containing the information for a specific number of titles. More 
specifically each VTO comprises the video, audio, and other reproduction data representing the content of each title in 
the set. and contioi data k> controlling the content data. 

The video zone VZ ic the video data unit processed by the authoring system, and comprises a specific number of 
video title sets Mote specifically, each video zone is a linear sequence of K + 1 video title sets numbered VTS #0 - VTS 
#K where K is an integer value of zero or greater. One video title set, preferably the first video title set VTS #0, is used 
as the video manager describing the content information of the titles contained in each video title set. 

The multimedia bttstr earn MBS is the largest control unit of the multimedia data bitstream handled by the authoring 
system of the present invention, and comprises plural video zones VZ. 

Authoring encoder EC 



A preferred embodiment of the authoring encoder EC according to the present invention for generating a new mul- 
timedia bitstream MBS by re-encoding the original multimedia bitstream MBS according to the scenario desired by the 
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user is shown in Fig 2 Note thai the ongmal multimedia bitstream MBS comprises a video stream St1 containing the 
video information, a sub-picture stream Sto containing caption text and othei auxiliaiy video information, and the audio 
stream St5 containing the audio information 

The video and audio sti earns are the bitstr earns containing the video and audio intoimation obtained from the 
source within a particulai period ol time The sub-picture stream is a bitstream containing momentary video information 
relevant to a particular scene. The sub-picture data encoded to a single scene may be captured to video memory and 
displayed continuously Irom the video memory tor plural scenes as may be necessary 

When this multimedia source data Sti . St3. and St5 is obtained from a live broadcast, the video and audio signals 
are supplied in real-time from a video camera or other imaging source; when the multimedia source data is reproduced 
from a video tape or other recording medium, the audio and video signals are not real-time signals. 

While the multimedia source stream is shown in Fig. 2 as comprising these three source signals, this is for conven- 
ience only, and it should be noted that the multimedia source stream may contain more than three types of source sig- 
nals, and may contain source data for different titles. Multimedia source data with audio, video, and sub-picture data for 
plural titles are referred to below as multi-title streams. 

As shown in Fig. 2, the authoring encoder EC comprises a scenario editor 100, encoding system controller 200, 
video encoder 300, video stream buffei 400, sub-picture encoder 500, sub-picture sti earn buffer 600, audio encoder 
700, audio stream buffer 800. system encoder 900, video zone formatter 1300. recorder 1200, and recording medium 
M. 

The video zone formatter 1300 comprises video object (VOB) buffer 1000, formatter 1100, and volume and file 
structure formatter 1400. 

The bitstream encoded by the authoring encoder EC of the present embodiment is recorded by way of example 
only to an optical disk. 

The scenario editor 100 of the authoring encoder EC outputs the scenario data. i.e.. the user-defined editing 
instructions. The scenario data controls editing the corresponding parts of the multimedia bitstream MBS according to 
the user's manipulation of the video, sub-picture, and audio components of the original multimedia title. This scenario 
editor 100 preferably comprises a display, speaker(s). keyboard, CPU. and source stream buffer. The scenario editor 
100 is connected to an external multimedia bitstream source from which the multimedia source data St1 , St3, and ~St5 
are supplied. 

The user is thus able to reproduce the video and audio components of the multimedia source data using the display 
and speaker to confirm the content of the-generated title The user is then able to edit the title content according to the 
desired scenario using the keyboard, mouse, and other command input devices while confirming the content of the title 
on the display and speakers. The result of this multimedia data manipulation is the scenario data St7. 

The scenario data St7 is basically a set of instructions describing what source data is selected from all or a subset 
of the source data containing plural titles within a defined time period, and how the selected source data is reassembled 
to reproduce the scenario (sequence) intended by the user. Based on the instructions received through the keyboard 
or other control device, the CPU codes the position, length, and the relative time-based positions of the edited parts of 
the respective multimedia source data streams Sti, St3, and St5 to generate the scenario data St7. 

The source stream butter has a specific capacity, and is used to delay the multimedia source data streams St1 , St3, 
and St5 a known time Td and then output streams Sti , St3, and St5. 

This delay is required for synchronization with the editor encoding process. More specifically, when data encoding 
and user generation of scenario data St7 are executed simultaneously, i.e., when encoding immediately follows editing, 
time Td is required to determine the content of the multimedia source data editing process based on the scenario data 
St7 as will be described further below. As a r esurt, the multimedia source data must be delayed by time Td to synchro- 
nize the editing process during the actual encoding opeation. Because this delay time Td is limited to the time required 
to synchronize the operation of the various system components in the case of sequential editing as described above, 
the source stream buffer is normally achieved by means of a high speed storage medium such as semiconductor mem- 
ory. 

During batch editing in which all muttimedia source data is encoded at once ("batch encoded") after scenario data 
St7 is generated for the complete title, delay time Td must be long enough to process the complete title or longer. In this 
case, the source stream buffer may be a low speed, high capacity storage medium such as video tape, magnetic disk, 
or optica! disk 

The structure (type) of media used for the source stream buffer may therefore be determined according to the delay 
time Td required and the allowable manufacturing cost. 

The encoding system controller 200 is connected to the scenario editor 100 and receives the scenario data St7 
therefrom. Based on the time-base position and length information of the edit segment contained in the scenario data 
St7, the encoding system controller 200 generates the encoding parameter signals St9, Stn, and St13 for encoding 
the edit segment of the multimedia source data. The encoding signals St9, Stn , and St 13 supply the parameters used 
for video, sub-picture, and audio encoding, including the encoding start and end timing. Note that multimedia source 
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* w data St1. St3. and St5 aie outpul aflei delay lime Td by the source stieam bufler. and aie therefore synchronized to 
encoding parameter signals St9. Sni . and Sti3. 

More specifically, encoding paiametei signal Sl9 is the video encoding signal specifying the encoding timing ot 
video stream Stl to extract the encoding segment tiom the video stream Stl and geneiate the video encoding unit. 

5 Encoding parameter signal Stii is likewise the sub-picture stream encoding signal used to generate the sub-picture 
encoding unit by specifying the encoding timing loi sub-pictuie stieam St3. Encoding parameter signal St 13 is the audio 
encoding signal used to generate the audio encoding unit by specilying the encoding timing toi audio stream St5. 

Based on the time-base relationship between the encoding segments ol streams Stl. St3. and St5 in the multime- 
dia source data contained in scenario data St7. the encoding system corrti oiler 200 generates the timing signals St2l . 

io St23. and St25 arranging the encoded multimedia -encoded stream in the specified time-base lelationship. 

The encoding system controller 200 also geneiates the reproduction time information IT defining the reproduction 
time of the title editing unit (video object. VOB). and the stieam encoding data St33 delining the system encode param- 
eters for multiplexing the encoded multimedia sti eam containing video, audio, and sub-picture data. Note that the repro- 
duction time information IT and stieam encoding data St33 are geneiated for the video object VOB of each title in one 

is video zone VZ. 

The encoding system contiollei 200 also geneiates the title sequence control signal St39. which declares the for- 
matting parameters for formatting the title editing units VOB of each of the streams in a particular time-base relationship 
as a multimedia bitstream. More specifically, the title sequence control signal St39 is used to control the connections 
between the title editing units (VOB) of each title in the multimedia bitstream MBS. or to control the sequence of the 

20 interleaved title editing unit (VOBs) interleaving the title editing units VOB of plural reproduction paths. 

The video encoder 300 is connected to the source stream buffer of the scenario editor 100 and to the encoding sys- 
tem controller 200. and receives therefrom the video stream Stl and video encoding parameter signal St9. respectively. 
Encoding parameters supplied by the video encoding signal St9 include the encoding start and end timing, bit rate, the 
encoding conditions for the encoding start and end, and the material type. Possible material types include NTSC or PAL 

25 video signal, and telecine converted material. Based on the video encoding parameter signal St9. the video encoder 
300 encodes a specific part of the video stieam Stl to generate the encoded video stream Stl 5. 

The sub-picture encoder 500 is similarly connected to the source stream buffer of the scenario editor 100 and to 
the encoding system controller 200. and receives therefrom the sub-picture stream St3 and sub-picture encoding 
parameter signal Stl 1 , respectively. Based on the sub-picture encoding parameter signal St1 1 , the sub-picture encoder 

30 500 encodes a specific part of the sub-picture stieam St3 to generate the encoded sub-picture stream St17. 

The audio encoder 700 is also connected to the source stream buffer of the scenario editor 1 00 and to the encoding 
system controller 200. and receives therefrom the audio stream St5 and audio encoding parameter signal St13, which 
supplies the encoding start and end timing. Based on the audio encoding parameter signal St 13. the audio encoder 700 
encodes a specific part of the audio stream St5 to generate the encoded audio stream Stl 9. 

35 The video stream buffer 400 is connected to the video encoder 300 and to the encoding system controller 200. The 
video stream buffer 400 stores the encoded video stream Stl 5 input from the video encoder 300, and outputs the stored 
encoded video stream Stl 5 as the time-delayed encoded video stream St27 based on the timing signal St21 supplied 
from the encoding system controller 200. 

The sub-picture stream bufler 600 is similarly connected to the sub-picture encoder 500 and to the encoding sys- 

40 tern controller 200. The sub-picture stream buffer 600 stores the encoded sub-picture stream Stl 7 outpul from the sub- 
picture encoder 500, and then outputs the stored encoded sub-picture stream Stl 7 as time-delayed encoded sub-pic- 
ture stream St29 based on the timing signal St23 supplied from the encoding system controller 200. 

The audio stream buffer 800 is similarly connected to the audio encoder 700 and to the encoding system controller 
200. The audio stream buffer 800 stores the encoded audio stream St IS input from the audio encoder 700, and then 

45 outputs the encoded audio stream St 19 as the time-delayed encoded audio stream St31 based on the timing signal 
St25 supplied from the encoding system controller 200. 

The system encoder 900 is connected to the video stream buffer 400, sub-picture stream buffer 600, audio stream 
buffer 800, and the encoding system controller 200, and is respectively supplied thereby with the time-delayed encoded 
video stream St27, time-delayed encoded sub-picture stream St29, time-delayed encoded audio stream St31, and the 

so stream encoding data St33. Note that the system encoder 900 is a multiplexer that multiplexes the time-delayed 
streams St27, St29, and St31 based on the stream encoding data St33 (timing signal) to generate title editing unit 
(VOB) St35. The stream encoding data St33 contains the system encoding parameters, including the encoding start 
and end timing. 

The video zone formatter 1300 is connected to the system encoder 900 and the encoding system controller 200 
55 from which the title editing unit (VOB) St35 and title sequence control signal St39 (timing signal) are respectively sup- 
plied. The title sequence control signal St39 contains the formatting start and end timing, and the formatting parameters 
used to generate (format) a multimedia bitstream MBS. The video zone formatter 1300 rearranges the title editing units 
(VOE) St35 in one video zone VZ in the scenario sequence defined by the user based on the title sequence control sig- 
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nal St39 lo general e the edited multimedia stieam data St43 

The multimedia bitstieam MBS S143 edited according to the user -defined scenario is then sent to the recorder 
1200 The lecordei 1200 processes the edited multimedia stream data St43 to the data stream St45 format ot the 
recording medium M, and thus records the tor matted data stream St45 to the recording medium M. Note that the mul- 
timedia bitstieam MBS recorded to the lecording medium M contains the volume tile structure VFS. which includes the 
physical address ot the data on the recording medium generated by the video zone formatter 1300. 

Note that the encoded multimedia bitsti earn MBS St35 may be output du ectly to the decoder to immediately repro- 
duce the edited title content. It will be obvious that the output multimedia bitstieam MBS will not in this case contain the 
volume file structure VFS. 

Authoring decoder DC 

A preferred embodiment of the authoring decoder DC used to decode the multimedia bitstream MBS edited by the 
authoring encoder EC of the present invention, and thereby reproduce the content of each title unit according to the 
user -defined scenaiio. is desciibed next below with reference to Fig. 3. Note that in the preferred embodiment 
described below the multimedia bitstream S145 encoded by the authoring encoder EC is recorded to the recording 
medium M 

As snown m Fig 3. the authoring decoder DC compr ises a multimedia bitstieam producer 2000. scenario selector 
2100. decoding system controller 2300, str eam buffer 2400, system decoder 2500, video buffer 2600, sub-picture buffer 
2700 audo butter 2800. synchronizer 2900, video decoder 3800, sub-picture decoder 3100, audio decoder 3200, syn- 
theses 3SOO vtdeo data output terminal 3600, and audio data output terminal 3700. 

Th* otsn earr producer 2000 comprises a r ecording media drive unit 2004 for driving the recording medium M; a 
readirw; **ad r-O06 tor reading the information recorded to the recording medium M and producing the binary read sig- 
nal S-*>" * <^r v *i r»oc«*sso» 2008 for variously processing the read signal St57 to generate the reproduced bitstream 
St6l * » <»r*nrtijri*yn controller 2002. 

r*3i»otXjc;ion controller 2002 is connected to the decoding system controller 2300 from which the multimedia 
bitstieam- '^>otfc>rt»or> control sional St53 is supplied, and in turn generates the reproduction control signals St55 and 
StS9 '*~-c-HC?*r«*» ior!troiwv3 the recording media drive unit (motor) 2004 and signal processor 2008. 

Sc r-a? trv- v/i*« <v *^?d video, sub-picture, and audio portions of the multimedia title edited by the authoring 
encoo*- t _ *>* oouced the authoring decoder DC comprises a scenario selector 2100 for selecting and reproduc- 
ing tne cr> ^ony>; scenes (titles). The scenario selector 2100 then outputs the selected titles as scenario data to 
the ajrx* «->g o^orj*-* ZC 

ir>^ v: o a r 103 preferably comprises a keyboard, CPU, and monitor. Using the keyboard, the user then 
inputs r>- vc#**vir e basec on the content of the scenario input by the authoring encoder EC. Based on the key- 

boarc *xxji trw- CP-J o**r>e«ates the scenario selection data St5l specifying the selected scenario. The scenario selec- 
tor 2K>: r„ co™*cteo d> infrared communications device, for example, to the decoding system controller 2300, to 
whicr a nputi m* sceoa? k> se*ecuon data StSi . 

ba:,e<3 Dn me scenario selection data StSi, the decoding system controller 2300 then generates the bitstream 
reproduction control s-gna' i>'^3 controlling the operation of the bitstream producer 2000. 

the stream tx^et ^»4<x nas a specific buffer capacity used to temporarily store the reproduced bitstream St61 input 
from me dtsti eam p»ockxe 20OC-. extract the address information and initial synchronisation data SCR (system clock 
reference) tc« eacn stream and generate bitstream control data St63. The stream buffer 2400 is also connected to the 
decoJ»r*y s>sie«vi co*-t!t>ie* 23D0. to which it supplies the generated bitstream control data St63. 

The syrthronj^e- 2900 is connected to the decoding system controller 2300 from which it receives the system clock 
reference SCR contained m the synchronization control data Stei to set the internal system clock STC and supply the 
reset system clock 5:79 to me decoding system controller 2300. 

Eased on mis system dock St79, the decoding system conti oiler 2300 also generates the stream read signal St65 
at a specific interval anc outputs the read signal St65 to the stream buffer 2400. 

Based on me supplied read signal St65, the stream buffer 2400 outputs the reproduced bitstream St61 at a specific 
interval to the system decoder 2500 as bitstream St57. 

Eased on the scenario selection data St5i. the decoding system controller 2300 generates the decoding signal 
St69 defining the stream las for me video, sub-picture, and audio bitstreams corresponding to the selected scenario, 
and outputs to the system decoder 2500. 

Based on the instructions contained in the decoding signal St69. the system decoder 2500 respectively outputs the 
vioeo. sub-picture, and audio bitstreams input from the stream buffer 2400 to the video buffer 2600, sub-picture buffer 
2700. and audio buffer 2800 as the encoded video stream St7i , encoded sub-picture stream St73, and encoded audio 
stream St75. 

The system decoder 2500 detects the presentation time stamp PTS and decoding time stamp DTS of the smallest 
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" w control unit in each bitstieam S167 to generate the time intoi mation signal St77. This time information signal St 77 is sup- 
plied to the synchi oncer 2900 through the decoding system controller 2300 as the synchronization control data St81. 

Based on this synchronization control data St8l. the synchronize! 2900 determines the decoding start timing 
whereby each ol the bitstt earns will be ai ranged in the correct sequence after decoding, and then generates and inputs 

5 the video stream decoding start signal St89 to the video decoder 3800 based on this decoding timing. The synchronizer 
2900 also generates and supplies the sub-picture decoding start signal St9i and audio stream decoding start signal 
SI93 to the sub-picture decoder 3100 and audio decoder 3200. respectively. 

The video decoder 3800 generates the video output request signal St84 based on the video stream decoding start 
signal St89. and outputs to the video butler 2600. In response to the video output request signal St84. the video butler 

w 2600 outputs the video stream St83 to the video decoder 3800. The video decoder 3800 thus detects the presentation 
time information contained in the video stream St83. and disables the video output request signal St84 when the length 
ot the received video stieam St83 is equivalent to the specified presentation time. A video stream equal in length to the 
specified presentation time is thus decoded by the video decoder 3800, which outputs the reproduced video signal 
St 104 to the synthesizer 3500. 

15 The sub-picture decoder 3100 similarly generates the sub-picture output r equest signal St86 based on the sub-pic- 

tuie decoding start signal St9l, and outputs to the sub-picture buffer 2700. In response to the sub-picture output 
request signal St86. the sub-picture buffer 2700 outputs the sub-picture stieam St85 to the sub-picture decoder 3100. 
Based on the presentation time information contained in the sub-picture stream St85, the sub-picture decoder 3100 
decodes a length of the sub-picture stieam St85 corresponding to the specified presentation time to reproduce and 
20 supply to the synthesizer 3500 the sub-picture signal St99. 

The synthesizer 3500 superimposes the video signal Stl04 and sub-picture signal St99 to generate and output the 
multi-picture video signal St105 to the video data output terminal 3600. 

The audio decoder 3200 generates and supplies to the audio buffer 2800 the audio output request signal St88 
based on the audio stream decoding start signal St93. The audio buffer 2800 thus outputs the audio stream St87 to the 
25 audio decoder 3200. The audio decoder 3200 decodes a length of the audio stream St87 corresponding to the specified 
presentation time based on the presentation time information contained in the audio stream St87. and outputs the 
decoded audio stream StIOl to the audio data output terminal 37O0. 

It is thus possible to reproduce a user -defined multimedia bitstieam MBS in real-time according to a user-defined 
scenario. More specifically, each time the user selects a different scenario, the authoring decoder DC is able to repro- 
30 duce the title content desired by the user in the desired sequence by reproducing the multimedia bitstream MBS corre- 
sponding to the selected scenario. 

It is therefore possible by means of the authoring system of the present invention to generate a multimedia b'rt- 
stream according to plural user-defined scenarios by real-time or batch encoding multimedia source data in a manner 
whereby the substreams of the smallest editing units (scenes), which can be divided into plural substreams, expressing 
35 the basic title content are arranged in a specific time-base relationship. 

The multimedia bitstream thus encoded can then be reproduced according to the one scenario selected from 
among plural possible scenarios. It is also possible to change scenarios while playback is in progress, i.e., to select a 
different scenario and dynamically generate a new multimedia bitstream according to the most recently selected sce- 
nario. It is also possible to dynamically select and reproduce any of plural scenes while reproducing the title content 
40 according to a desired scenario. 

It is therefore possible by means of the authoring system of the present invention to encode and not only reproduce 
but to repeatedly reproduce a multimedia bitstream MBS in real-time. 

A detail of the authoring system is disclosed Japanese Patent Application filed September 27. 1996, and entitled 
and assigned to the same assignee as the present application. 

45 

DVD 

An example of a digital video disk (DVD) with only one recording surface (a single-sided DVD) is shown in Fig. 4. 

The DVD recording medium RCl in the preferred embodiment of the invention comprises a data recording surface 
so RSI to and from which data is written and read by emitting laser beam LS, and a protective layer PL1 covering the data 
recording surface RSi . A backing layer BLl is also provided on the back of data recording surface RSI . The side of the 
disk on which protective layer PL1 is provided is therefore referred to below as side SA (commonly "side A"), and the 
opposite side (on which the backing layer BLl is provided) is relerred to as side SB ("side B"). Note that digital video 
disk recording media having a single data recording surface RSi on only one side such as this DVD recording medium 
55 RCl is commonly called a single-sided single layer disk. 

A detailed illustration of area Cl in Fig. 4 is shown in Fig. 5. Note that the data recording surface RSI is formed by 
applying a metallic thin film or other reflective coating as a data layer 410S on a first transparent layer 4108 having a 
particular thickness Tl . This first transparent layer 4108 also functions as the protective layer PL1 . A second transpar- 
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enl substrate 4111 ol a thickness T2 functions as the- backing tayei BLl, and is bonded to the lust transparent layer 
4108 by means o1 an adhesive layer 4 1 10 disposed therebetween 

A printing layer 4112 for printing a disk label may also be disposed on the second transparent substrate 4111 as 
necessary. The printing layer 41 12 does not usually cover the entire surface area of the second transparent substrate 
4111 (backing layer BL1). but only the area needed to print the text and graphics of the disk label The area o1 second 
transparent substrate 4111 to which the printing layer 41 12 is not formed may be left exposed. Light reflected from the 
data layer 4109 (metallic thin film) forming the data r ecoiding surface RSl can therefore be directly observed where the 
label is not printed when the digital video disk is viewed from side SB. As a result, the background looks like a silver - 
white over which the printed text and graphics float when the metallic thin film is an aluminum thin film, lor example. 

Note that it is only necessary to provide the printing layer 4112 where needed for printing, and it is not necessary 
to provide the printing layer 4112 over the entire surface of the backing layer BLl. 

A detailed illustration ol area C2 in Fig. 5 is shown in Fig. 6. Pits and lands are molded to the common contact sur- 
face between the first transparent layer 4 1 08 and the data layer 4109 on side SA from which data is read by emitting a 
laser beam LS, and data is recorded by var ying the lengths of the pits and lands (i.e.. the length of the intervals between 
the pits). More specifically, the pit and land conliguiation formed on the lirst transparent layer 4108 is transferred to the 
data layer 4109. The lengths of the pits and lands aie shorter, and the pitch of the data tracks formed by the pit 
sequences is narrower, than with a conventional Compact Disc (CD). The surface recording density is therefore greatly 
improved. 

Side SA of the first transparent layer 41 08 on which data pits are not formed is a flat surface. The second transpar- 
ent substrate 4111 is for reinforcement, and is a transparent panel made from the same material as the first transparent 
layer 4108 with both sides flat. Thickness Tl and T2 are preferably equal and commonly approximately 0.6 mm. but the 
invention shall not be so limited. 

As with a CD, information is read by irradiating the surface with a laser beam LS and detecting the change in the 
reflectivity of the light spot. Because the objective lens aperture NA can be large and the wavelength I of the light beam 
small in a digital video disk system, the diameter of the light spot Ls used can be reduced to approximately 1/1 .6 the 
light spot needed to read a CD. Note that this means the resolution of the laser beam LS in the DVD system is approx- 
imately 1.6 times the resolution of a conventional CD system. 

The optical system used to read data from the digital video disk uses a short 650 nm wavelength red semiconductor 
laser and an objective lens with a 0.6 mm aperture NA. By thus also reducing the thickness T of the transparent panels 
to 0.6 mm, more than 5 GB of data can be stored to one side of a 120 mm diameter optical disk. 

It is therefore possible to store motion picture (video) images having an extremely large per unit data size to a digital 
video disk system disk without losing image quality because the storage capacity of a single-sided, single-tayer record- 
ing medium RC1 with one data recording surface RSl as thus described is nearly ten times the storage capacity of a 
conventional CD. As a result, while the video presentation time of a conventional CD system is approximately 74 min- 
utes if image quality is sacrificed, high quality video images with a video presentation time exceeding two hours can be 
recorded to a DVD. 

The digital video disk is therefore well-suited as a recording medium for video images. 

A digital video disk recording medium with plural recording surfaces RS as described above is shown in Figs. 7 and 
8. The DVD recording medium RC2 shown in Fig. 7 comprises two recording surfaces, i.e., first recording surface RSl 
and semi-transparent second recording surface RS2, on the same side, i.e. side SA, of the disk. Data can be simulta- 
neously recorded or reproduced from these two recording surfaces by using different laser beams LS1 and LS2 for the 
first recording surface RSl and the second recording surface RS2. ft is also possible to read/write both recording sur- 
faces RSl and RS2 using only one of the laser beams LSI or LS2. Note that recording media thus comprised are called 
"single-side, dual-layer disks." 

It should also be noted that while two recording surfaces RSl and RS2 are provided in this example, it is also pos- 
sible to produce digital video disk recording media having more than two recording surfaces RS. Disks thus comprised 
are known as "single-sided, multi-layer disks." 

Though comprising two recording surfaces similarly to the recording media shown in Fig. 7, the DVD recording 
medium RC3 shown in Fig. 8 has the recording surfaces on opposite sides of the disk, i. e., has the first data recording 
surface RSl on side SA and the second data recording surface RS2 on side SB. It will also be obvious that while only 
two recording surfaces are shown on one digital video disk in this example, more than two recording surfaces may also 
be formed on a double-sided digital video disk. As with the recording medium shown in Fig. 7. it is also possible to pro- 
vide two separate laser beams LSI and LS2 for recording surfaces RSl and RS2, or to read/write both recording sur- 
faces RSl and RS2 using a single laser beam. Note that this type of digital video disk is called a "double-sided, dual- 
layer disk." H will also be obvious that a double-sided digital video disk can be comprised with two or more recording 
surfaces per side. This type of disk is called a "double-sided, multi-layer disk." 

A plan view from the laser beam LS irradiation side of the recording surface RS of the DVD recording medium RC 
is shown in Fig. 9 and Fig. 10. Note that a continuous spiral data recording track TR is provided from the inside circum- 
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* " ference to the outside ciicumleience ol the DVD. The data lecording track TR is divided into pluial sectors each having 
the same known storage capacity. Note that tor simplicity only the data recording track TR is shown in Fig. 9 with more 
than three sectors per revolution. 

As shown in Fig. 9. the data recording track TR is normally tormed clockwise inside to outside (see airow Dr A) trom 
f the inside end point IA at the inside circumierence oi disk RCA to the outside end point OA at the outside circumference 
ol the disk with the disk RCA rotating counter clockwise RdA. This type ol disk RCA is called a clockwise disk, and the 
recording track formed thereon is called a clockwise track TRA. 

Depending upon the application, the recording track TRB may be formed clockwise from outside to inside circum- 
ference (see arrow DrB in Fig. 10) from the outside end point OE at the outside circumference of disk RCB to the inside 
70 end point IB at the inside circumference of the disk with the disk RCB rotating clockwise RdB. Because the recording 
track appears to wind counterclockwise when viewed from the inside circumference to the outside circumference on 
disks with the recording track tormed in the direction o1 anow DrB. these disks are referred to as counterclockwise disk 
RCB with counterclockwise track TRB to distinguish them from disk RCA in Fig. 9. Note that track directions Dr A and 
DrB are the track paths along which the laser beam travels when scanning the tracks tor recording and playback. Direc- 
ts tion of disk rotation Fid A in which disk RCA turns is thus opposite the direction of track path DiA. and direction of disk 
rotation RdB in which disk RCB tur ns is thus opposite the diiection ol track path DrB. 

An exploded view of the single-sided, dual-layer disk RC2 shown in Fig. 7 is shown as disk RC2o in Fig. 11. Note 
that the recording tracks tormed on the two recording surfaces run in opposite directions. Specifically, a clockwise 
recording track TRA as shown in Fig. S is formed in clockwise direction DrA on the (lower) first data recording surface 
20 RSI . and a counterclockwise recording track TRB formed in counterclockwise direction DrB as shown in Fig. 10 is pro- 
vided on the (upper) second data recording surface RS2. As a result, the outside end points OA and OB of the first and 
second (top and bottom) tracks are at the same radial position relative to the center axis of the disk RC2o. Note that 
track paths DrA and DrB of tracks TR are also the data read/write directions to disk RC. The first and second (top and 
bottom) recording tracks thus wind opposite each other with this disk RC. i.e.. the track paths DrA and DrB of the top 
25 and bottom recording layers are opposite track paths. 

Opposite track path type, single-sided, dual-layer disks RC2o rotate in direction RdA corresponding to the first 
recording surface RSl with the laser beam LS traveling along track path DrA to trace the recording track on the first 
recording surface RS1. When the laser beam LS reaches the outside end point OA. the laser beam LS can be refo- 
cused to end point OB on the second recording surface RS2 to continue tracing the recording track from the first to the 
30 second recording surface uninterrupted. The physical distance between the recording tracks TRA and TRB on the first 
and second recording surfaces RSl and RS2 can thus be instantaneously eliminated by simply adjusting the focus of 
the laser beam LS. 

It is therefore possible with an opposite track path type, single-sided, dual-layer disk RC2o to easily process the 
recording tracks disposed to physically discrete top and bottom recording surfaces as a single continuous recording 

35 track. It is therefore also possible in an authoring system as described above with reference to Fig. 1 to continuously 
record the multimedia bitstream MBS that is the largest multimedia data management unit to two discrete recording sur- 
faces RSI and RS2 on a single recording medium RC2o. 

It should be noted that the tracks on recording surfaces RSl and RS2 can be wound in the directions opposite 
those described above, i.e., the counterclockwise track TRB may be provided on the first recording surface RSl and the 

ao clockwise track TRA on the second recording surface RS2. In this case the direction of disk rotation is also changed to 
a clockwise rotation RdB, thereby enabling the two recording surfaces to be used as comprising a single continuous 
recording track as described above. For simplification , a further example of this type of disk is therefore neither shown 
nor described below. 

It is therefore possible by thus constructing the digital video disk to record the multimedia bitstream MBS for a fea- 
<s ture-length title to a single opposite track path type, single-sided, dual-layer disk RC2o Note that this type of digital 
video disk medium is called a single-sided dual-layer disk with opposite track paths. 

Another example of the single-sided, dual-layer DVD recording medium RC2 shown in Fig. 7 is shown as disk RC2p 
in Fig. 12. The recording tracks formed on both first and second recording surfaces RSl and RS2 are clockwise tracks 
TRA as shown in Fig. 9. In this case, the single-sided, dual-layer disk RC2p rotates counterclockwise in the direction of 
so arrow RdA, and the direction of laser beam LS travel is the same as the direction of the track spiral, i.e.. the track paths 
of the top and bottom recording surfaces are mutually parallel (parallel track paths). The outside end points OA of both 
top and bottom tracks are again preferably positioned at the same radial position relative to the center axis of the disk 
RC2p as described above. As also described above with disk RC2o shown in Fig. 1 1 . the access point can be instan- 
taneously shifted from outside end point OA of track TRA on the first recording surface RSl to the outside end point OA 
55 of track TRA on the second recording surface RS2 by appropriately adjusting the focus of the laser beam LS at outside 
end point OA. 

However, for the laser beam LS to continuously access the clockwise recording track TRA on the second recording 
surface RS2, the recording medium RC2p must be driven in the opposite direction (clockwise, opposite direction RdA). 
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Depending on the radial position o1 the lasei beam LS'.. however, it is inettrueni to change the rotational direction of the 
recording medium As shown by the diagonal auow in Fig 12, the lasei beam LS is theieloie moved from the outside 
end point OA of the tiacK on the first recording surface RSl to the inside end point IA of the track on the second record- 
ing surface RS2 to use these physically disci ete lecoidmg tracks as one logically continuous recording track. 

Rather than using the recording tracks on top and bottom recording surfaces as one continuous recording track, it 
is also possible to use the recording tracks to record the multimedia bitstr earns MBS tor different titles. This type of dig- 
ital video disk recording medium is called a "single-sided, dual- layer disk with parallel track paths." 

Note that if the direction o1 the tracks formed on the recording surfaces RSl and RS2 is opposite that described 
above, i.e.. counterclockwise recording tracks TRB are formed, disk operation remains the same as that described 
above except for the direction of disk rotation, which is clockwise as shown by arrow RdB. 

Whether using clockwise or counterclockwise recording tracks, the single-sided, dual-layer disk RC2p with parallel 
track paths thus described is well-suited to storing on a single disk encyclopedia and similar multimedia bitstreams 
compr ising multiple titles that are frequently and randomly accessed. 

An exploded view ot the dual-sided single-layer DVD recording medium RC3 comprising one recording surface 
layer RSl and RS2 on each side as shown in Fig. 8 is shown as DVD recording medium RC3s in Fig. 13. Clockwise 
recording track TRA is piovided on the one recording surface RSl , and a counterclockwise recording track TRB is pro- 
vided on the other recording surface RS2. As in the preceding recording media, the outside end points OA and OB of 
the recording tracks on each recording surface ar e preferably positioned at the same radial position relative to the 
center axis of the DVD recording medium RC3s. 

Note that while the recording tracks on these recording surfaces RSl and RS2 rotate in opposite directions, the 
track paths are symmetrical. This type of recording medium is therefore known as a double-sided dual layer disk with 
symmetrical track paths. This double-sided dual layer disk with symmetrical track paths RC3s rotates indirection RdA 
when reading/writing the first recording sudace RSl. As a result, the track path on the second recording surface RS2 
on the opposite side is opposite the direction DrB in which the track winds, i.e., direction DrA. Accessing both recording 
surfaces RSl and RS2 using a single laser beam LS is therefore not realistic irrespective of whether access is contin- 
uous or non-continuous. In addition, a multimedia bitstream MBS is separately recorded to the recording surfaces on 
the first and second sides of the disk. 

A different example of the double-sided single layer disk RC3 shown in Fig. 8 is shown in Fig. 14 as disk RC3a. 
Note that this disk comprises clockwise recording tracks TRA as shown in Fig. 9 on both recording surfaces RS1 and 
RS2. As with the preceding recording media, the outside end points OA and OA of the recording tracks on each record- 
ing surface ar e pr eferably positioned at the same radial position relative to the center axis of the DVD recording medium 
RC3a. Unlike the double-sided dual layer disk with symmetrical track paths RC3s described above, the tracks on these 
recording surfaces RSl and RS2 are asymmetrical. This type of disk is therefore known as a double-sided dual layer 
disk with asymmetrical track paths. This double-sided dual layer disk with asymmetrical track paths RC3a rotates in 
direction RdA when reading/writing the first recording surface RSI . As a result, the track path on the second recording 
surface RS2 on the opposite side is opposite the direction DrA in which the track winds, i.e.. direction DrB. 

This means that if a laser beam LS is driven continuously from the inside circumference to the outside circumfer- 
ence on the first recording surface RSl. and then from the outside circumference to the inside circumference on the 
second recording surface RS2, both sides of the recording medium RC3a can be read/written without turning thedisk 
over and without providing different laser beams for the two sides. 

The track paths tor recording surfaces RSl and RS2 are also the same with this double-sided dual layer disk with 
asymmetrical track paths RC3a. As a result, it is also possible to read/write both sides of the disk without providing sep- 
arate laser beams for each side if the recording medium RC3a is turned over between sides, and the read/write appa- 
ratus can therefore be constructed economically. 

It should be noted that this recording medium remains functionally identical even if counterclockwise recording 
track TRB is provided in place of clockwise recording track TRA on both recording surfaces RSI and RS2. 

As described above, the true value of a DVD system whereby the storage capacity of the recording medium can be 
easily increased by using a multiple layer recording surface is realized in multimedia applications whereby plural video 
data units, plural audio data units, and plural graphics data units recorded to a single disk are reproduced through inter- 
active operation by the user. 

It is therefore possible to achieve one long-standing desire of software (programming) providers, specifically, to pro- 
vide programming content such as a commercial movie on a single recording medium in plural versions for different lan- 
guage and demographic groups while retaining the image quality of the original. 

Parental control 

Content providers of movie and video titles have conventionally had to produce, supply, and manage the inventory 
of individual titles in multiple languages, typically the language of each distribution market, and multi-rated title pack- 
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ages conforming to the paiental conliot (censoiship) tegulations ot individual countries in Europe and North America. 
The time and lesouices lequiied toi this aie significant. While high image quality is obviously important, the program- 
ming content must aiso be consistently lepioducible. 

The digital video disk recording medium is close to solving these problems. 

Multiple ang [e> 

One interactive operation widely sought in multimedia applications today is for the usei to be able to change the 
position hom which a scene is viewed during reproduction of that scene This capability is achieved by means of the 
multiple angle function 

1 his murtcxe angle function makes possible applications whereby, tor example, a user can watch a baseball game 
tiom ditiei ent angles (ck virtual positions in the stadium), and can freely switch between the views while viewing is in 
progress in trus e* ample oi a baseball game, the available angles may include a position behind the backstop centered 
on the catche« bane- and prtcher ; one from behind the backstop centeied on a fieldei. the pitcher, and the catcher; and 
one from cent-i Utrki showmg the view to the pitcher and catcher. To meet these lequiiements, the digital video disk 
system us*^> MPEG ttnr sanitr basic standard formal used with Video-CDs to record the video, audio, graphics, and 
otnei signal data u>oause> o* tne differences in storage capacity, transfer rates, and signal processing performance 
withm the iep»DcJucton apparatus.* DVD uses MPEG2, the compression method and data format of which differ slightly 
fiom the MPEG i lo^v i/-«3 *ntn Video CDs. 

ft should bo nc*«* trv? com ent oi and differences between the MPEGl and MPEG2 standards have no direct 
relationship to the o* rr^. p.«n^m invention, and further description is therefore omitted below (for more informa- 

tion, see MPEG ux<»<^«^ 1 1 17? and ISO-13818). 

The data sti ucxlm t o*p*[v:h m*™ according to the present invention is described in detail below with reference 
to Figs 16. 17. 18 ic r-' 




A fully functional anc t» »ci>oaJ pa»enta lock playback function and multi-angle scene playback function must enable 
the user to modit> tne % r*t~~ outxr m mmor. subtle ways while still presenting substantially the same video and audio 
output It these functions * *■ acne*eo Dy preparing and recording separate titles satisfying each of the many possible 
parental lock and muni ±c e^e piayback requests, titles that are substantially identical and differ in only minor ways 

must be recorded to i** • «*-x> -.v>; medium. This results in identical data being repeatedly recorded to the larger part of 
the recording medium a^v: s*yv!»canti> reduces the utilization efficiency of the available storage capacity. More partic- 
ularly, h is virtually impo^s*** to teco* d discrete titles satisfying every possible request even using the massive capacity 
of the digital video dis*- m«o»um While it may be concluded that this problem can be easily solved by increasing the 
capacity of the recording meOum. this is an obviously undesirable solution when the effective use of available system 
resources is consider ec 

Using multi -scene convex me concept ot which is described in another section below, in a DVD system, it is possi- 
ble to dynamically censa »xt t»aes to* numerous variations of the same basic content using the smallest possible amount 
ot data, and thereby e«ect v«*> utilize the available system resources (recording medium). More specifically, titles that 
can be played oacfc wnn rvmei ous variations are constructed from basic (common) scene periods containing data com- 
mon to each title, and nvrf?' vcen* periods comprising groups of different scenes corresponding to the various requests. 
During r epr oduction p>«r u*«s ^ atie to freely and at any time select particular scenes from the multi-scene periods to 
dynamically construct a vz* conic* rrung to the desired content, e.g.. a title omitting certain scenes using the parental 
lock control function 

Note that murti-scen* con>o e^-aJtvinc; a parental lock playback control function and multi-angle scene playback is 
described in another sector tx*>* with reference to Fig. 21. 

Data structure oi the DVD %frl?CD 

The data structure used »n tne authoring system of a digital video disk system according to the present invention is 
shown in Fig. 22 To recotfl a multimedia bitstream MBS. this digital video disk system divides the recording medium 
into three major recording ai«>as the lead-in area LI, the volume space VS. and the lead-out area LO. 

The lead-in area LI is p*o/K3ed at the inside circumference area oi the optical disk. In the disks described with ref- 
erence to Figs. S and 10. me lead-m area LI is positioned at the inside end points IA and IB of each track. Data for sta- 
bilizing the operation of the reoroduang apparatus when reading starts is written to the lead-in area LI. 

The lead-out area LO is cc* r espondingiy located at the outside circumference of the optical disk, i.e., at outside end 
points OA and OB oi each tracfc m the disks described with reference to Figs. S and 10. Data identifying the end of the 
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volume space VS is recorded rn this lead-out area LC 

The volume space VS is located between the lead-in area LI and lead-out area LO. and is recoided as a one- 
dimensional array of n+1 (where n is an integer gieatei than or equal to zeio) 2048-byte logic sectois LS. The logic sec- 
tors LS are sequentially number £0. #1 . #2. .. sn The volume space VS is also divided into a volume and file structure 
management area VFS and a file data stiuctuie aiea FDS 

The volume and file structure management aiea VFS comprises m+1 logic sectors LS#0 to LS#m (where m is an 
integer greater than or equal to zero and less than n The file data structure FDS comprises n-m logic sectors LS #m+l 
to LS #n. 

Note that this file data structure aiea FDS conesponds to the multimedia brtstream MBS shown in Fig. 1 and 
described above. 

The volume file structure VFS is the file system tor managing the data stored to the volume space VS as tiles, and 
is divided into logic sectors LS#0 - LSfcm where m is the number of sectois required to store all data needed to manage 
the entire disk, and is a natural number less than n. Information for the files stored to the tile data structure aiea FDS is 
written to the volume file structure VFS according to a known specification such as ISO-9660 oi ISO-13346. 

The file data structure area FDS compiises n-m logic sectois LS#m - LS#n. each composing a video managei 
VMG sized to an integer multiple of the logic sector (2048 x I, whei e I is a known integer), and K video title sets VTS #1 
- VTS#k (where k is a natural number less than 100). 

The video manager VMG stores the title management information for the entire disk, and information for building a 
volume menu used to set and change reproduction control of the entire volume. 

Any video title set VTS #k is also called a "video file" representing a title comprising video, audio, and/or still image 
data. 

The internal structure of each video title set VTS shown in Fig. 22 is shown in Fig. 16. Each video title set VTS com- 
prises VTS information VTSI describing the management information for the entire disk, and the VTS title video objects 
VOB (VTSTT_VOBS). i.e.. the system stream of the multimedia bitsti earn. The VTS information VTSI is described first 
below, followed by the VTS title VOBS 

The VTS information primarily includes the VTSI management table VTSI_MAT and VTSPGC information table 
VTS_PGCIT. 

The VTSI management table VTSI_MAT stores such information as the internal structure of the video title set VTS. 
the number of selectable audio streams contained in the video title set VTS. the number of sub-pictures, and the video 
title set VTS location (storage address). 

The VTSPGC information table VTS_PGCIT records i (where i is a natural number) program chain (PGC) data 
blocks VTS_PGCI #1 - VTS_PGCI #i for controlling the playback sequence. Each of the table entries VTS_PGCI #i is 
a data entry expressing the program chain, and comprises j (where j is a natural number) cell playback information 
blocks C_PBI #1 - C_PBI #j. Each cell playback information block C_PBI #j contains the playback sequence of the cell 
and playback control information. 

The program chain PGC is a conceptual structure describing the story of the title content, and therefore defines the 
structure of each title by describing the cell playback sequence. Note that these cells are described in detail below. 

If, for example, the video title set information relates to the menus, the video title set information VTSI is stored to 
a buffer in the playback device when playback starts. If the user then presses a MENU button on a remote control 
device, for example, during playback, the playback device references the buffer to fetch the menu information and dis- 
play the top menu #1 . If the menus are hierarchical, the main menu stored as program chain information VTS_PGCI #1 
may be displayed, for example, by pressing the MENU button, VTS_PGCI #2 - #S may correspond to submenus 
accessed using the numeric keypad on the remote control, and VTS_PGCI #10 and higher may correspond to addi- 
tional submenus further down the hierarchy. Alternatively, VTS_PGCl #1 may be the top menu displayed by pressing 
the MENU button, while VTS_PGCI #2 and higher may be voice guidance reproduced by pressing the corresponding 
numeric key. 

The menus themselves are expressed by the plural program chains defined in this table. As a result, the menus 
may be freely constructed in various ways, and shall not be limited to hierarchical or non-hierarchical menus or menus 
containing voice guidance. 

In the case of a movie, for example, the video title set information VTSI is stored to a buffer in the playback device 
when playback starts, the playback device references the cell playback sequence described by the program chain PGC, 
and reproduces the system stream. 

The "cells" referenced here may be all or part of the system stream, and are used as access points during playback. 
Cells can therefore be used, for example, as the "chapters" into which a title may be divided. 

Note that each of the PGC information entries C_PBS #j contain both cell playback processing information and a 
cell information table. The cell playback processing information comprises the processing information needed to repro- 
duce the cell, such as the presentation time and number of repetitions. More specifically, this information includes the 
cell block mode CBM, cell block type CBT, seamless playback flag SFF. interleaved allocation flag IAF, STC resetting 
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Hag STCDF. cell presentation time C_PBTM. seamless angle change Hag SACF. first cell VOBU start address 
C_FVOBU_SA. and the last cell VOBU stait addiess C_LVOBU_SA. 

Note that seamless playback ieteis to the reproduction in a digital video disk system o1 multimedia data including 
video, audio, and sub-picture data without intermittent breaks in the data or information. Seamless playback is 
5 described in detail in another section below with reterence to Fig. 23 and Fig. 24. 

The cell block mode CBM indicates whether plural cells constitute one lunctional block. The cell playback informa- 
tion of each cell in a functional block is arranged consecutively in the PGC information. The cell block mode CBM ol the 
first cell playback information in this sequence contains the value of the first cell in the block, and the cell block mode 
CBM of the last cell playback information in this sequence contains the value ol the last cell in the block The cell block 
to mode CBM of each cell arrayed between these lirst and last cells contains a value indicating that the cell is a cell 
between these first and last cells in that block. 

The cell block type CBT identities the type ot the block indicated by the cell block mode CBM. For example, when 
a multiple angle function is enabled, the cell information corresponding to each ot the reproducible angles is pro- 
grammed as one of the functional blocks mentioned above, and the type of these functional blocks is defined by a value 
75 identifying "angle" in the cell block type CBT for each cell in that block. 

The seamless playback flag SPF simply indicates whether the conesponding cell is to be linked and played back 
seamlessly with the cell or cell block reproduced immediately therebefore. To seamlessly reproduce a given cell with 
the preceding cell or cell block, the seamless playback flag SPF is set to 1 in the cell playback information for that cell; 
otherwise SPF is set to 0. 

20 The interleaved allocation flag IAF stores a value identifying whether the cell exists in a contiguous or interleaved 

block. If the cell is part of an interleaved block, the flag IAF is set to 1 ; otherwise rt is set to 0. 

The STC resetting flag STCDF identifies whether the system time clock STC used for synchronization must be 
reset when the cell is played back; when resetting the system time clock STC is necessary, the STC resetting flag 
STCDF is set to 1. 

25 The seamless angle change flag SACF stores a value indicating whether a cell in a multi-angle period should be 

connected seamlessly at an angle change. If the angle change is seamless, the seamless angle change flag SACF is 
set to 1 ; otherwise it is set to 0. 

The cell presentation time C_PBTM expresses the cell presentation time with video frame precision. 
The first cell VOBU start address C_FVOBU_SA is the VOBU start address of the first cell in a block, and is also 
30 expressed as the distance from the logic sector of the first cell in the VTS title VOBS (VTSTT_VOBS) as measured by 
the number of sectors. 

The last cell VOBU start address C_LVOBU_SA is the VOBU start address of the last cell in the block. The value 
of this address is expressed as the distance from the logic sector of the first cell in the VTS title VOBS (VTSTT_ VOBS) 
as measured by the number of sectors. 
35 The VTS title VOBS (VTSTT_VOBS). i.e.. the multimedia system stream data, is described next. The system 
stream data VTSTT_VOBS comprises i (where i is a natural number) system streams SS. each of which is referred to 
as a Video object" (VOB). Each video object VOB #1 - VOB #i comprises at least one video data block interleaved with 
up to a maximum eight audio data blocks and up to a maximum 32 sub-picture data blocks. 

Each video object VOB comprises q (where q is a natural number) cells C#i - C#q. Each cell C comprises r (where 
40 r is a natural number) video object units VOBU £1 - VOBU #r. 

Each video object unit VOBU comprises plural group_of_pictures GOP. and the audio and sub-pictures corre- 
sponding to the playback of said plural group_of_pictures GOP. Note that the group_of_pictures GOP corresponds to 
the video encoding refresh cycle. Each video object unit VOBU also starts with an NV pack, i.e., the control data for that 
VOBU. 

45 The structure of the navigation packs NV is described with reference to Fig. 18. 

Before describing the navigation pack NV, the internal structure of the video zone VZ (see Fig. 22), i.e., the system 
stream St35 encoded by the authoring encoder EC described with reference to Fig. 25, is described with reference to 
Fig. 17. Note that the encoded video stream St15 shown in Fig. 17 is the compressed one-dimensional video data 
stream encoded by the video encoder 300. The encoded audio stream St19 is likewise the compressed one-dimen- 

50 sional audio data stream multiplexing the right and left stereo audio channels encoded by the audio encoder 700. Note 
that the audio signal shall not be limited to a stereo signal, and may also be a multichannel surround-sound signal. 

The system stream (title editing unit VOB) St35 is a one dimensional array of packs with a byte size corresponding 
to the logic sectors LS #n having a 2048-byte capacity as described using Fig. 21. A stream control pack is placed at 
the beginning of the title editing unit (VOB) St35. i.e.. at the beginning of the video object unit VOBU. This stream control 

55 pack is called the "navigation pack NV", and records the data arrangement in the system stream and other control infor - 
mation. 

The encoded video stream St15 and the encoded audio stream St19 are packetized in byte units corresponding to 
the system stream packs. These packets are shown in Fig. 17 as packets VI, V2. VS, V4... and Al, A2, A3.... As shown 
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m Fig 17. these packets aie interleaved in the appiopnate sequence as, system stieam St35. thus forming a packet 
stream, with consideration given to the decodei butiei size and the time lequned by the decoder to expand the video 
and audio data packets In the example shown in Hg 17. the packet stieam is interleaved in the sequence V1, V2, Al. 
V3. V4. A2 

Note that the sequence shown in Fig 17 interleaves one video data unit with one audio data unit. Significantly 
increased recording/playback capacity, high speed lecording/playback. and performance improvements in the signal 
processing LSi enable the DVD system to lecord plural audio data and pluial sub-picture data {graphics data) to one 
video data unit in a single interleaved MPEG system stream, and thereby enable the user to select the specific audio 
data and sub-pictuie data to be iepioduced duiing playback. The stiuctuie o1 the system stieam used in this type of 
DVD system is shown in Fig 18 and described below. 

As m Fig i 7. me packetized encoded video stream Stl5 is shown in Fig 16 as VI . V2, V3. V4, ... In this example, 
howe/ei . there is not just one encoded audio stieam Stl9, but three encoded audio streams Stl9A. St19B, and StISC 
input as me souice cata There are also two encoded sub-picture streams Sti 7A and Sti 7B input as the source data 
sub-picture stieams These six compiessed data streams. St15, St19A. St19B. Stl9C. St17A and St17B. are inter- 
leaved to a single system stream St35 

The video data n> e«>coded according to the MPEG specification with the gioup_ot__pidui es GOP being the unit of 
compiession in genet ai each g>oup_or_p«ctures GOP contains 15 frames in the case of an NTSC signal, but the spe- 
cific number ot tiames cornp^essed to one GOP is variable. The stream management pack, which describes the man- 
agement data contai-uog *> e*amr>e the relationship between interleaved data, is also interleaved at the GOP unit 
interval Because the g*oc*r o* p<r&*es GOP unit is based on the video data, changing the number of video frames per 
OOP unit changes th* rt* o* tr*> tueam management packs. This interval is expressed in terms of the presentation 
time on the digital vOeo mtt^ * ?ange from 0.4 sec. to 1.0 sec. referenced to the GOP unit. If the presentation time 
of contiguous plural GC*' c*rwr, in^n i sec., the management data packs for the video data of the plural GOP 

units is interleaved tr a «**>j»~ v?'#-*rn 

These manao^rrpn- rut* r^>5, ,«-«**-ed to as navigation packs NV in the digital video disk system. The data 
from one navigation pao • t r*» pacxei immediately preceding the next navigation pack NV forms one video object 
unit VOBU In general o^e uxt*g_xx.s paysaO unit that can be defined as one scene is called a video object VOB, and 
each video object VOB conu^. pk#ai *-oeo object units VOBU. Data sets of plural video objects VOB form a VOB set 
(VOBS) Note that these data *m t«st used in the digital video disk. 

When plural of these data steams are interleaved, the navigation packs NV defining the relationship between the 
interleaved packs must also t>e r^te* leaded at a defined unit known as the pack number unit. Each group_of_jpictures 
GOP is normally a unit comarwg aop*o*irnately 0. 5 sec. of video data, which is equivalent to the presentation time 
required for 12-15 tra-nes ana one navigation pack NV is generally interleaved with the number of data packets 
required tor this presentation tm#- 

The stream management rTtcwmation contained in the interleaved video, audio, and sub-picture data packets con- 
stituting the system stream »s oesenbec below with reference to Fig. 19 As shown in Fig. 19, the data contained in the 
system stream is recorded -n a H>mai packed or packetized according to the MPEG2 standard. Thepacket structure is 
essentially the same tor viceo auoc and sub-picture data. One pack in the digital video disk system has a 2048 byte 
capacity as described atx>/e ana contains a pack header PKH and one packet PES; each packet PES contains a 
packet header PTH and data t*oc* 

The pack headei PKH -eco»cJs the time at which that pack is to be sent from stream buffer 2400 to system decoder 
2500 (see Fig 26). i e . trie system docK reference SCR defining the reference time for synchronized audio-visual data 
playback. The MPEG s'-anu<*ta asj>umes that the system clock reference SCR is the reference clock for the entire 
decoder operation With such <jrb> media as the digital video disk, howevei, time management specific to individual disk 
players can be used, and a <e»^eoc* c*ock for the decoder system is therefore separately provided. 

The packet heacei p 1 m s^t*^ i f contains a presentation time stamp PTS and a decoding time stamp DTS, both 
of which are placed m the paoei bcto»e the access unit (the decoding unit). The presentation time stamp PTS defines 
the time at which the videc data o» auoio data contained in the packet should be output as the playback output after 
being decoded, and the decoong time stamp DTS defines the time at which the video stream should tie decoded. Note 
that the presentation time stamp PTS effectively defines the display start timing of the access unit, and the decoding 
time stamp DTS effectively detmes the decoding start timing of the access unit. If the PTS and DTS are the same time, 
the DTS is omitted 

The packet header PTH also contains an 8-bit field called the stream ID identifying the packet type. i.e.. whether 
the packet is a video packet containing a video data stream, a private packet, or an MPEG audio packet. 

Private packets unoer the MPEG2 standard are data packets of which the content can be freely defined. Private 
packet 1 in this embodiment o* the invention is used to carry audio data other than the MPEG audio data, and sub-pic- 
ture data; private packet 2 came* me PCI packet and DSI packet. 

Private packets 1 and 2 each comprise a packet header, private data area, and data area. The private data area 
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contains an 8-bit sub-stream ID indicating whethei the lecoided data is audio data or sub-picture data. The audio data 
delined by private packet 2 may be defined as any o1 eight types SO - #7 of linear PCM oi AC-3 encoded data. Sub 
picture data may be defined as one oi up to 32 types #0 - #31. 

The data area is the lield to which data compressed according to the MPEG2 specification is written if the stored 
i data is video data; linear PCM. AC-3. or MPEG encoded data is written H audio data is stored; oi graphics data com- 
pressed by runlength coding is written it sub-picture data is stored. 

MPEG2-compressed video data may be compressed by constant bit rate (CBR) or variable bit rate (VBR) coding. 
With constant bit rate coding, the video stieam is inpul continuously to the video butter at a constant rate. This contrasts 
with variable bit rate coding in which the video stieam is input intermittently to the video butler, thereby making it pos- 
70 sible to suppress the generation of unnecessary code. Both constant bit rate and variable bit rate coding can be used 
in the digital video disk system. 

Because MPEG video data is compressed with variable length coding, the data quantity in each group_ot_pictuies 
GOP is not constant. The video and audio decoding times also ditter. and the time-base relationship between the video 
and audio data read from an optical disk, and the time-base relationship between the video and audio data output from 
is the decode*, do not match. The method of time-base synchronizing the video and audio data is therefore described in 
detail below with reference to Fig. 26. but is desciibed biietly below based on constant bit rate coding. 

The navigation pack NV structure is shown in Fig. 20. Each navigation pack NV starts with a pack header PKH. and 
contains a PC i packet and DSI packet. 

Az» Ococ* txxi above, the pack header PKH records the time at which that pack is to be sent from stream buffer 2400 
20 to syctcn decoder 2500 (see Fig. 26 ). i.e.. the system clock reference SCR defining the reference time for synchro- 
nic ©c audic-vruiai data playback. 

Eacri PO packet contains PCI General Information (PCI_GI) and Angle Information for Non-seamless playback 
(NMSl *OUl 

Th*» =>r: irrtrvmation (PCI_GI) declares the display time of the first video frame (the Start PTM of VOBU 

25 (VOf-;: ' p - W}- anrJ tne display time of the last video frame (End PTM of VOBU (VOBU_E_PTM)). in the correspond- 
ing *«3*c otjeo i>vt VCBU with system clock precision (90 KHz). 

w me* r?>a*on tor Non-seamless playback (NMSL_AGLI) states the read start address of the correspond- 

ing ^ v; ar.^rr VOBU when the angle is changed expressed as the number of sectors from the beginning of the 
vo*c or E*»cause there are nine or fewer angles in this example, there are nine angle address declaration 

30 c**% :,-«-.t"\afcr^ K** of Angle Cell #1 for Non-seamless playback ( N M SL_ AG L_C 1 _ D STA) to Destination Address 
of r, r> t*cr seamless playback ( N M S L_ AG L_ C9_D STA) . 

f pa>^ contains DSI General Information (DSIJ3I), Seamless Playback Information (SML_PBI). and 

Ang>* m*;*fviw k> ^amiess playback (SML_AGLI). 

W formation (DSI_GI) declares the address of the last pack in the video object unit VOBU, i. e., the 

25 Erx: **r>*-,i x> *OC3 CVCBU_EA), expressed as the number of sectors from the beginning of the video object unit 
VOfcU 

w>w wsd^»«-b4» p^yOacK is described in detail later, it should be noted that the continuously read data units must 
be *x*»**s+*<3 irrun%y*>neG) at the system stream level as an interleaved unit ILVU in order to seamlessly reproduce 
spiit o corrt>n«<! ttwn. ^xr a) system streams interleaved with the interleaved unit ILVU as the smallest unit are defined 

<0 as an irre*l*av«3 DKX> 

The ^am^ p\a,t>a;> information (SML_PB1) is declared to seamlessly reproduce the stream interleaved with 
the me«»ea*«c ur* ILVU the smallest data unit, and contains an Interleaved Unit Flag (ILVU flag) identifying whether 
the uxe^wU'^ vow uujed unit VOBU is an interleaved block. The ILVU flag indicates whether the video object unit 
VOBU ii m an inte*ieav*c3 brock, and is set to 1 when it is. Otherwise the ILVU flag is set to 0. 

<5 Wnen a vioeo oDjeci irwi VOBU is in an interleaved block, a Unit END flag is declared to indicate whether the video 

objeci unit VOBU * the last VOBU in the interleaved unit ILVU. Because the interleaved unit ILVU is the data unit for 
continuous reading, the Unit END flag is set to l if the VOBU currently being read is the last VOBU in the interleaved 
unit ILVU Otherwise the Unit END flag is set to 0. 

An interleaved Unn End Address (ILVU_E A) identifying the address of the last pack in the ILVU to which the VOBU 

so belongs, and the starting address of the next interleaved unit ILVU. Next Interleaved Unit Start Address (NT_ILVU_SA), 
are also declared when a video object unit VOBU is in an interleaved block. Both the Interleaved Unit End Address 
(ILVU_EA) and Nexi interleaved Unit Start Address (NT_ILVU_SA) are expressed as the number of sectors from the 
navigation pack NV of that VOBU. 

When two system streams are seamlessly connected but the audio components of the two system streams are not 

55 contiguous, particularly immediately before and after the seam, h is necessary to pause the audio output to synchronize 
the audio and video components of the system stream following the seam. Note that non-contiguous audio may result 
from different audio signals being recording with the corresponding video blocks. With an NTSC signal, for example, the 
video frame cycle is approximately 33. 33 msec while the AC-3 audio frame cycle is 32 msec. 
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"lo enable this iesynchroni?a1ion. audio lejwoduction stopping time: l and 2. i e . Audio Stop PTM 1 in VOB 
(VOB_ A_STP_PTM1). and Audio Stop PTM2 in VOB (VOB_A_STP_Pl M?). indicating the time at which the audio is to 
be paused; and audio lepioduction stopping periods 1 and 2. i.e.. Audio Gap Length 1 in VOB (VOB_A_GAP_LENl) 
and Audio Gap Length 2 in VOB (VOE_ A GAF LI N?), indicating loi how long the audio is to be paused, are also 
declared in the DSI packet. Note that these times aie specHied at the system clock piecision (90 kHz). 

The Angle Inlormation loi Seamless playback (SML_AGLI) declaies the read start address when the angle is 
changed. Note that this lield is valid when seamless, multi-angle control is enabled This address is also expressed as 
the number oi sectors liom the navigation pack NV ol that VOBU. Because theie are nine oi tewer angles, there are 
nine angle address declaration cells Destination Address o1 Angle Cell #1 tor Seamless playback 
( SML_ AGL_C 1 _ D STA) to Destination Addiess of Angle Cell #9 lor seamless playback <SM L_ AG L_C9_DSTA). 

Note also that each title is edited in video object (VOB) units. Interleaved video objects (interleaved title editing 
units) are reterenced as "VOBS"; and the encoded lange ot the source data is the encoding unit. 

PVP encoder 

A preferred embodiment of a digital video disk system authoring encoder ECD in which the multimedia bitstream 
authoring system according to the present invention is applied to a digital video disk system is described below and 
shown in Fig. 25. It will be obvious that the authoring encoder ECD applied to the digital video disk system, referred to 
below as a DVD encoder, is substantially identical to the authoring encoder EC shown in Fig. 2. The basic difference 
between these encoders is the replacement in the DVD encoder ECD of the video zone formatter 1 300 of the authoring 
encoder EC above with a VOB buffer 1 000 and formatter 11 00. It will also be obvious that the bitstream encoded by this 
DVD encoder ECD is recorded to a digital video disk medium M. The operation of this DVD encoder ECD is therefore 
described below in comparison with the authoring encoder EC described above. 

As in the above authoring encoder EC. the encoding system controller 200 generates control signals St9. Stll. 
St13, St21 . St23. St25. St33. and St39 based on the scenario data St7 describing the user -defined editing instructions 
input from the scenario editor 100. and controls the video encoder 300. sub-picture encoder 500. and audio encoder 
700 in the DVD encoder ECD. Note that the usei-defined editing instructions in the DVD encoder ECD are a superset 
of the editing instructions of the authoring encoder EC described above. 

Specifically, the user-defined editing instructions (scenario data St7) in the DVD encoder ECD similarly describe 
what source data is selected from all or a subset of the source data containing plural titles within a defined time period, 
and how the selected source data is reassembled to reproduce the scenario (sequence) intended by the user. The sce- 
nario data St7 of the DVD encoder ECD, however, further contains such information as: the number of streams con- 
tained in the editing units, which are obtained by splitting a multi-title source stream into blocks at a constant time 
interval; the number of audio and sub-picture data cells contained in each stream, and the sub-picture display time and 
period; whether the title is a multi-rated title enabling parental lock control; whether the user content is selected from 
plural streams including, for example, multiple viewing angles; and the method of connecting scenes when the angle is 
switched among the multiple viewing angles. 

The scenario data St7 oi the DVD encoder ECD also contains control information on a video object VOB unit basis. 
This information is required to encode the media source stream, and specifically includes such information as whether 
there are multiple angles or parental control features. When multiple angle viewing is enabled, the scenario data St7 
also contains the encoding bit rate of each stream considering data interleaving and the disk capacity, the start and end 
times of each control, and whether a seamless connection should be made between the preceding and following 
streams. 

The encoding system controller 200 extracts this information from the scenario data St7, and generates the encod- 
ing information table and encoding parameters required for encoding control. The encoding information table and 
encoding parameters are described with reference to Figs. 27, 28, and 2S below. 

The stream encoding data St33 contains the system stream encoding parameters and system encoding start and 
end timing values required by the DVD system to generate the VOEs. These system stream encoding parameters 
include the conditions for connecting one video object VOB with those before and after, the number of audio streams, 
the audio encoding information and audio Ids. the number of sub-pictures and the sub-picture Ids, the video playback 
starting time information VPTS. and the audio playback starting time information APTS. 

The title sequence control signal St39 supplies the multimedia bitstream MBS formatting start and end timing infor- 
mation and formatting parameters declaring the reproduction control information and interleave information. 

Based on the video encoding parameter and encoding start/end timing signal St9. the video encoder 300 encodes 
a specific part of the video stream Stl to generate an elementary stream conforming to the MPEG2 Video standard 
defined in ISO- 138 16. This elementary stream is output to the video stream buffer 400 as encoded video stream Stl 5. 

Note that while the video encoder 300 generates an elementary stream conforming to the MPEG2 Video standard 
defined in ISO-138l£. specific encoding parameters are input via the video encoding parameter signal StS, including 
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the encoding stail and end liming, bit late, the encoding conditions lor the encoding start and end. the material type, 
including whethei the material is an NTSC oi PAL video signal 01 telecme converted material, and whether the encoding 
mode is set loi either open GOP or closed GOP encoding. 

The MPEG2 coding method is basically an interlrame coding method using the correlation between frames for 

5 maximum signal compression, i.e.. the Irame being coded (the taiget tiame) is coded by referencing frames before 
and/or after the target frame. However, intra-coded frames, i. e. . frames that are coded based solely on the content of 
the target frame, are also inserted to avoid error propagation and enable accessibility from mid-stream (random 
access). The coding unit containing at least one intra-coded frame ("intra- frame") is called a group_of ^pictures GOP. 
A gioup_oi_pictures GOP in which coding is closed completely within that GOP is known as a "closed GOP. " A 

w group_of__pictures GOP containing a frame coded with reference to a frame in a preceding or following (ISO- 1381 8 
DOES NOT LIMIT P- and B-pictuie CODING to referencing PAST frames) group__ot_pictures GOP is an "open GOP." 
It is therefore possible to playback a closed GOP using only that GOP. Reproducing an open GOP. however, also 
requires the presence oi the referenced GOP. generally the GOP preceding the open GOP. 

The GOP is often used as the access unit. For example, the GOP may be used as the playback start point for repro- 

15 ducing a title from the middle, as a transition point in a movie, or for fast-forward play and other special reproduction 
modes. High speed reproduction can be achieved in such cases by reproducing only the intra-frame coded frames in a 
GOP or by reproducing only frames in GOP units. 

Based on the sub-picture stream encoding parameter signal Stl 1 . the sub-picture encoder 500 encodes a specific 
part of the sub-picture str eam StS to generate a variable length coded bitstream of bitmapped data. This variable length 

20 coded bitstream data is output as the encoded sub-picture stream Stl 7 to the sub-picture stream buffer 600. 

Based on the audio encoding parameter signal Stl 3, the audio encoder 700 encodes a specific part of the audio 
stream StS to generate the encoded audio data. This encoded audio data may be data based on the MPEG1 audio 
standard defined in ISO-m72 and the MPEG2 audio standard defined in ISO-13818. AC-3 audio data, or PCM 
(LPCM) data. Note that the methods and means of encoding audio data according to these standards are known and 

25 commonly available. 

The video stream buffer 400 is connected to the video encoder 300 and to the encoding system controller 200. The 
video stream buffer 400 stores the encoded video stream Stl 5 input from the video encoder 300. and outputs the stored 
encoded video stream Stl 5 as the time-delayed encoded video stream St27 based on the timing signal St21 supplied 
from the encoding system controller 200. 

so The sub-picture stream butler 600 is similarly connected to the sub-picture encoder 500 and to the encoding sys- 

tem controller 200. The sub-pictur e stream buffer 600 stores the encoded sub-picture stream St1 7 input from the sub- 
picture encoder 500. and then outputs the stored encoded sub-picture stream Stl 7 as time-delayed encoded sub-pic- 
ture stream St29 based on the timing signal St23 supplied from the encoding system controller 200. 

The audio stream bulfer 800 is similarly connected to the audio encoder 700 and to the encoding system controller 

35 200. The audio stream butter 800 stores the encoded audio stream St 19 input from the audio encoder 700. and then 
outputs the encoded audio stream Sti9 as the time-delayed encoded audio stream St3l based on the timing signal 
St25 supplied from the encoding system controller 200. 

The system encoder 900 is connected to the video stream buffer 400, sub-picture stream buffer 600, audio stream 
buffer 800, and the encoding system controller 200, and is respectively supplied thereby with the time-delayed encoded 

ao video stream St27, time-delayed encoded sub-picture stream St29, time-delayed encoded audio stream St3l, and the 
system stream encoding parameter data St33. Note that the system encoder 900 is a multiplexer that multiplexes the 
time-delayed streams St27, St29, and Stol based on the stream encoding data St33 (timing signal) to generate title 
editing units (VOBs) St35. 

The VOB buffer 1000 temporarily siores the video objects VOBs produced by the system encoder 900. The format- 
<s ter 1 100 reads the delayed video objects VOB from the VOB buffer 1000 based on the title sequence control signal St39 
to generate one video zone VZ. and adds the volume file structure VFS to generate the edited multimedia stream data 
St43. 

The multimedia bitstream MBS St43 edited according to the user -defined scenario is then sent to the recorder 
1200. The recorder 1200 processes the edited multimedia stream data St43 to the data stream St45 format of the 
so recording medium M, and thus records the formatted data stream St45 to the recording medium M. 

DVD decoder 

A preferred embodiment of a digital video disk system authoring decoder DCD in which the multimedia bitstream 
55 authoring system of the present invention is applied to a digital video disk system is described below and shown in Fig. 
26. The authoring decoder DCD applied to the digital video disk system, referred to below as a DVD decoder DCD, 
decodes the multimedia bitstream MBS edited using the DVD encoder ECD of the present invention, and recreates the 
content of each title according to the user -defined scenario. It will also be obvious that the multimedia bitstream St45 
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encoded by this DVD encode! ECD is recorded to a druital video disk medium M. 

Thebasic configuration of the DVD decodei DCD according to this embodiment is the same as that of the authoring 
decoder DC shown in Fig. 3. The differences aie thai a diffeient video decoder 3801 (shown as 3800 in Fig. 26) is used 
in place of the video decoder 3800. and a reordering butler 3300 and selector 3400 are disposed between the video 
decoder 3801 and synthesizer 3500. 

Note that the selector 3400 is connected to the synchronize! 2900, and is controlled by a switching signal St103. 

The operation of this DVD decoder DCD is theiefor e described below in comparison with the authoring decoder DC 
described above. 

As shown in Fig. 26. the DVD decodei DCD comprises a multimedia bitstream producer 2000. scenario selector 
2 100. decoding system controller 2300. sti earn buffer 2400. system decoder 2500, video buffer 2600. sub-picture buffer 
2700. audio butter 2800. synchronizer 2900. video decodei 3801. reordering buffer 3300. sub-picture decoder 3100. 
audio decoder 3200. selector 3400. synthesizer 3500. video data output terminal 3600, and audio data output terminal 
3700. 

The bitstream producer 2000 comprises a recording media drive unit 2004 for driving the recording medium M; a 
reading head 2006 for leading the information lecoided to the recording medium M and producing the binary read sig- 
nal St57. a signal processor 2008 for variously processing the read signal Sl57 to generate the leproduced bitstieam 
St6l ; and a reproduction controller 2002. 

The reproduction controller 2002 is connected to the decoding system controller 2300 from which the multimedia 
bitstream reproduction control signal St53 is supplied, and in turn generates the reproduction control signals St55 and 
St59 recoectrveiy controlling the recording media drive unit (motor) 2004 and signal processor 2008. 

So trwa? tne user -defined video, sub-picture, and audio portions of the multimedia title edited by the authoring 
encode* EC are reproduced, the authoring decoder DC comprises a scenario selector 2100 for selecting and reproduc- 
ing trie cotre^corvJiog scenes (titles). The scenar io selector 2100 then outputs the selected titles as scenario data to 
the OVO rn*-rr5** DCD 

Tn* sr_*-rv* «r> v**-no* ? 100 preferably comprises a keyboard. CPU. and monitor. Using the keyboard, the user then 
inputs tr*» c^ec &cenat »c based on the content of the scenario input by the DVD encoder ECD. Based on the key- 
boarc rxxjt ttv C^'J generates the scenario selection data St5l specifying the selected scenario. The scenario selec- 
tor 2100 iv conr+ctnc r me decoding system controller 2300 by an infrared communications device, for example, and 
inputs o**^***^ vc*rv* k> selection data St5l to the decoding system controller 2300. 

in* «.?:**rn zxj**. hoc nas a specific buffer capacity used to temporarily store the reproduced bitstream St61 input 
from t>«» t>tv&««<~ pror5oc«* ?000. extract the volume file structure VFS. the initial synchronization data SCR (system 
clock fe*~*~<r r pao and the VOBU control information (DSI) in the navigation pack NV, to generate the bit- 
stream con* or cuv* ' t^i The stream buffer 2400 is also connected to the decoding system controller 2300. to which it 
suppi es tt*- g^r^- a!**: t>tsi?eam control data St63. 

Eaveo or tr*e 'xe^c selection data St5l supplied by the scenario selector 2100, the decoding system controller 
2300 rx»r g*=«rwe»a*«, t^* t>-stream reproduction control signal St53 controlling the operation of the bitstream producer 
2000 The cecoo«r>c ^>'e^ controller 2300 also extracts the user-defined playback instruction data from the bitstream 
reproouctior! conro» vgrua* btS3. and generates the decoding information table required for decoding control. This 
decoorig trro* matKDn tar*e -s described further below with reference to Figs. 62 and 63. The decoding system controller 
2300 arso extracts Tr*e w»e miormation recorded to the optical disk M from the file data structure area FDS of the bit- 
stream corrtoi aata i>rtc tc generate the title information signal St200. Note that the extracted title information includes 
the voeo manage* VVG VIS information VTSI. the PGC information entries C_PBI #j, and the cell presentation time 
C_PETM 

Note that the b-tsti earr control data St63 is generated in pack units as shown in Fig. IS, and is supplied from the 
stream buffer 2400 to tne oecodmg system controller 2300, to which the stream buffer 2400 is connected. 

The synchronize* 2900 rs connected to the decoding system controller 2300 from which it receives the system clock 
reference SCR contained m tne synchronization control data St&l to set the internal system clock STC and supply the 
reset system clock S:79 to the decoding system controller 2300. 

Based on this system dock St79, the decoding system controller 2300 also generates the stream read signal St65 
at a specHic interval anc outputs the read signal St65 to the stream buffer 2400. Note that the read unit in this case is 
the pack 

The method of generating the stream read signal St65 is described next 

The decoding system controller 2300 compares the system clock reference SCR contained in the stream control 
data extracted from the stream buffer 2400 with the system dock St7S supplied from the synchronizer 2900. and gen- 
erates the read request signal St65 when the system clock S179 is greater than the system clock reference SCR of the 
bitstream control data St63 Pack transfers are controlled by executing this control process on a pack unit. 

Based on the scenanc selection data St5l. the decoding system controller 2300 generates the decoding signal 
St69 defining the stream Ics for the video, sub-picture, and audio bitstreams corresponding to the selected scenario, 
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and outputs to the system decoder 2500. 

When a title contains pluial audio tracks, e.g. audio tiacks in Japanese. English. Fiench. and/or othei languages, 
and plural sub-picture tracks tor subtitles in Japanese. English. Fiench. and/or olhei languages, toi example, a disci ete 
ID is assigned to each o1 the language tiacks. As desaibed above with leleience to Fig. 19. a stieam ID is assigned to 

5 the video data and MPEG audio data, and a substi earn ID is assigned to the sub-picture data. AC-3 audio data, lineai 
PCM data, and navigation pack NV information. While the user need never be awaie ol these ID numbers, the user can 
select the language o1 the audio and/oi subtitles using the scenario selector 2100. II English language audio is 
selected, tor example, the ID con esponding to the English audio tiack is sent to the decoding system controller 2300 
as scenario selection data St5l. The decoding system contiollei 2300 then adds this ID to the decoding signal St69 

w output to the system decoder 2500. 

Based on the instructions contained in the decoding signal St69. the system decoder 2500 respectively outputs the 
video, sub-picture, and audio bitstreams input liom the stieam butter 2400 to the video butter 2600. sub-pictuie butlei 
2700. and audio butter 2800 as the encoded video stream St7l , encoded sub-picture stieam St73. and encoded audio 
stream St75. Thus, when the stieam ID input tiom the scenaiio selectoi 2100 and the pack ID input from the stieam 

is butler 2400 match, the system decodei 2500 outputs the conesponding packs to the lespective buffers (i.e.. the video 
buffer 2600, sub-picture buffei 2700. and audio buffer 2800). 

The system decoder 2500 detects the presentation time stamp PTS and decoding time stamp DTS of the smallest 
control unit in each bitstream St67 to generate the time information signal St77. This time information signal St77 is sup- 
plied to the synchronizer 2900 through the decoding system controller 2300 as the synchronization control data St81 . 

20 Based on this synchronization control data St81, the synchronizer 2900 determines the decoding start timing 

whereby each of the bitstreams will be arranged in the correct sequence after decoding, and then generates and inputs 
the video stream decoding start signal St89 to the video decoder 3801 based on this decoding timing. The synchronizer 
2900 also generates and supplies the sub-picture decoding start signal St91 and audio stieam decoding start signal 
St93 to the sub-picture decoder 3100 and audio decoder 3200. respectively. 

25 The video decoder 3801 generates the video output request signal St84 based on the video stream decoding start 

signal St89. and outputs to the video buffer 2600. In response to the video output request signal St84. the video buffer 
2600 outputs the video stream St83 to the video decoder 3801 . The video decoder 3801 thus detects the presentation 
time information contained in the video stream St83. and disables the video output request signal St84 when the length 
of the received video stream St83 is equivalent to the specified presentation time. A video stream equal in length to the 

so specified presentation time is thus decoded by the video decoder 3801 . which outputs the reproduced video signal St95 
to the reordering buffer 3300 and selector 3400. 

Because the encoded video stream is coded using the intertrame correlations between pictures, the coded order 
and display order do not necessarily match on a frame unit basis. The video cannot, therefore, be displayed in the 
decoded order. The decoded frames are therefore temporarily stored to the reordering buffer 3300. The synchronizer 

35 2900 therefore controls the switching signal StlOS so that the reproduced video signal St95 output from the video 
decoder 3800 and the reordering buffer output St97 are appropriately selected and output in the display order to the 
synthesizer 3500. 

The sub-picture decoder 3100 similarly generates the sub-picture output request signal St86 based on the sub-pic- 
ture decoding start signal St9l, and outputs to the sub-picture buffer 2700. In response to the sub-picture output 
40 request signal St86, the sub-picture buffer 2700 outputs the sub-picture stream St85 to the sub-picture decoder 3100. 
Based on the presentation time information contained in the sub-picture stream St85, the sub-picture decoder 3100 
decodes a length of the sub-picture stream St85 corresponding to the specified presentation time to reproduce and 
supply to the synthesizer 3500 the sub-picture signal St99. 

The synthesizer 3500 superimposes the selector 3400 output with the sub-picture signal St99 to generate and out- 
45 put the video signal StlOS to the video data output terminal 3600. 

The audio decoder 3200 generates and supplies to the audio buffer 2800 the audio output request signal St88 
based on the audio stream decoding start signal St93. The audio buffer 2800 thus outputs the audio stream St87 to the 
audio decoder 3200. The audio decoder 3200 decodes a length of the audio stream St87 corresponding to the specif ied 
presentation time based on the presentation time information contained in the audio stream St87, and outputs the 
so decoded audio stream St101 to the audio data output terminal S700. 

It is thus possible to reproduce a user-defined multimedia bitstream MBS in real-time according to a user-defined 
scenario. More specifically, each time the user selects a different scenario, the DVD decoder DCD is able to reproduce 
the title content desiied by the user in the desired sequence by reproducing the multimedia bitstream MBS correspond- 
ing to the selected scenario. 

as It should be noted that the decoding system controller 2300 may supply the title information signal St200 to the sce- 

nario selector 2100 by means of the infrared communications device mentioned above or another means. Interactive 
scenario selection controlled by the user can also be made possible by the scenario selector 2100 extracting the title 
information recorded to the optical disk M from the file data structure area FDS of the bitstream control data St6S con- 
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tained in ihe title information signal S1200. and displaying this title infotmalion on a display loi usei selection. 

Note, further, that the stieam buffei ?400. video butlei 2600. sub-pictuie buffer 2700. audio butler 2800. and reor- 
dering buttei 3300 aie expressed above and in the figues as separate entities because they are functionally different, 
tt will be obvious, howevei. that a single butlei memoiy can be controlled to piovide the same discrete functionality by 
time-share controlled use ot a butlei memoiy with an opeiatmg speed plural times taster than the read and write rates 
ot these separate buffers 

Multi-scene control 

The concept ot multiple angle scene contiol according to the present invention is described below with reference 
to Fig. 21. As desciibed above, titles that can be played back with numeious variations are constructed from basic 
scene periods containing data common to each title, and multi-scene periods comprising groups ol different scenes cor- 
responding to the various scenario requests. In Fig. 21 . scenes 1, 5. and 8 aie the common scenes of the basic scene 
periods. The multi-angle scenes (angles 1 , 2, and 3) between scenes 1 and 5. and the parental locked scenes (scenes 
6 and 7) between scenes 5 and 8, aie the multi-scene peiiods. 

Scenes taken fiom diffeient angles, i.e.. angles 1 , 2. and 3 in this example, can be dynamically selected and repro- 
duced during playback in the multi -angle scene period. In the parental locked scene period, however, only one of the 
available scenes, scenes 6 and 7. having different content can be selected, and must be selected statically before play- 
back begins. 

Which of these scenes from the multi scene peiiods is to be selected and reproduced is defined by the user oper- 
ating the scenario selector 2100 and thereby generating the scenario selection data St51. In scenario 1 in Fig. 21 the 
user can freely select any of the multi-angle scenes, and scene 6 has been preselected for output in the parental locked 
scene period. Similarly in scenario 2. the user can freely select any of the multi-angle scenes, and scene 7 has been 
preselected for output in the parental locked scene period. 

With reference to Figs 30 and 31. furthermore, the contents of the program chain information VTS_PGC1 is 
described. In Fig. 30. the case that a scenario requested by the user is shown with respect to a VTSI data construction. 
The scenario 1 and scenario 2 shown in Fig. 21 are described as program chain information VTS_PGC#1 and 
VTS_PGC#2. VTS_PGC#1 describing the scenario 1 consists of cell playback information C_PB!#1 corresponding to 
scene 1. C_PBI#2. C_P6I#3. and C_PBI#4 within a multi-angle cell block. C_PBI#5 corresponding to scene 5, 
C_PB1#6 corresponding to scene 6. and C_PBI#7 corresponding to scene 8. 

VTS_PGCI#2 describing the scenario 2 consists of cell playback information C_PBI#1 corresponding to scene 1, 
C_PBI#2. C_PBJ#3, and C_PB!#4 within a multi-angle cell block corresponding to a multi-angle scene, C_PBI#5 corre- 
sponding to scene 5, C_PBI£6 corresponding to scene 7, and C_PBI#7 corresponding to scene 8. According to the dig- 
ital video system data structure, a scene which is a control unit of a scenario is described as a cell which is a unit 
thereunder, thus a scenario requested by a user can be obtained. 

In Fig. 31 , the case that a scenario requested by the user shown in Fig. 21 is shown with respect to a VOB data 
construction VTSTT_VOBS. As specif ically shown in Fig. 31 , the two scenarios i and 2 use the same VOB data in com- 
mon. With respect to a single scene commonly owned by each scenario, VOB#l corresponding to scene 1 , VOB#5 cor- 
responding to scene 5, and VOB#8 corresponding to scene 8 are arranged in n on -inter leaved block which is the 
contiguous block. 

With respect to the multi-angle data commonly owned by scenarios 1 and 2, one angle scene data is constructed 
by a single VOB. Specifically speaking, angle 1 is constructed by VOBS2, and angle 2 is constructed by VOB#3, angle 
3 is constructed by VOB#4. Thus constructed multi-angle data is formed as the interleaved block for the sake of switch- 
ing between each angle and seamless reproduction of each angle data. Scenes 6 and 7 peculiar to scenarios 1 and 2, 
respectively, are formed as the interleaved block for the sake of seamless reproduction between common scenes before 
and behind thereof as well as seamless reproduction between each scene. 

As described in the above, the user s requesting scenario shown in Fig. 21 can be realized by utilizing the video 
title playback control information shown in Fig. 30 and the title playback VOB data structure shown in Fig. 31 . 

Seamless playback 

The seamless playback capability briefly mentioned above with regard to the digital video disk system data struc- 
ture is described below. Note that seamless playback refers to the reproduction in a digital video disk system of multi- 
media data including video, audio, and sub-picture data without intermittent breaks in the data or information between 
basic scene periods, between basic scene periods and multi-scene periods, and between multi-scene periods. 

Hardware factors contributing to intermittent playback of this data and title content include decoder underflow, i.e., 
an imbalance between the source data input speed and the decoding speed of the input source data. 

Other factors relate to the properties of the playback data. When the playback data is data that must be continu- 
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ously reproduced lot a constani lime unit in ordei lot the user to understand the content oi information, e.g.. audio data, 
data continuity is lost when the required continuous presentation time cannot be assured. Reproduction of such infor- 
mation whereby the required continuity is assured rs referred to as contiguous information reproduction." or "seamless 
information reproduction ." Reproduction of this information when the required continuity cannot be assured is referred 
5 to as "non-continuous information reproduction.' or "non-seamless information reproduction." It is obvious that contin- 
uous information reproduction and non-continuous information reproduction are. respectively, seamless and non-seam- 
less reproduction. 

Note that seamless reproduction can be further categorized as seamless data reproduction and seamless informa- 
tion reproduction. Seamless data reproduction is defined as preventing physical blanks or interruptions in the data play- 
w back (intermittent reproduction) as a result of a buffer underflow state, for example. Seamless information reproduction 
is defined as preventing apparent interruptions in the information when perceived by the user (intermittent presentation) 
when recognizing information from the playback data where there are no actual physical breaks in the data reproduc- 
tion. 

75 Details of Seamless playback 

The specific method enabling seamless reproduction as thus described is described later below with reference to 
Figs. 23 and 24. 

20 Interleaving 

The DVD data system streams described above are recorded using an appropriate authoring encoder EC as a 
movie or other multimedia title on a DVD recording medium. Note that the following description refers to a movie as the 
multimedia title being processed, but it will be obvious that the invention shall not be so limited. 
25 Supplying a single movie in a format enabling the movie to be used in plural different cultural regions or countries 

r equires the script to be recorded in the various languages used in those regions or countries. It may even necessitate 
editing the content to conform to the mor es and moral expectations of different cultures. Even using such a large-capac- 
ity storage system as the DVD system, however, it is necessary to reduce the bit rate, and therefore the image quality, 
if plural full-length titles edited from a single common source title are recorded to a single disk. This problem can be 

so solved by recording the common parts of plural titles only once, and recording the segments different in each title for 
each diflerent title only. This method makes it possible to record plural titles for different countries or cultures to a single 
optical disk without reducing the bit rate, and, therefore, retaining high image quality. 

As shown in Fig. 21 , the titles recorded to a single optical disk contain basic scene periods of scenes common to 
all scenarios, and multi-scene periods containing scenes specific to certain scenarios, to provide parental lock control 

25 and multi-angle scene control functions. 

In the case oi the parental lock control function, titles containing sex scenes, violent scenes, or other scenes 
deemed unsuitable for children, i.e., so-called "adult scenes," are recorded with a combination of common scenes, adult 
scenes, and children's scenes. These title streams are achieved by arraying the adult and children's scenes to multi- 
scene periods between the common basic scene periods. 

40 Multi-angle control can be achieved in a conventional single-angle title by recording plural multimedia scenes 

obtained by recording the subjects from the desired plural camera angles to the multi-scene periods arrayed between 
the common basic scene periods. Note, however, that while these plural scenes are described here as scenes recorded 
from different camera angles (positions), it will be obvious that the scenes may be recorded from the same camera 
angle but at different times, data generated by computer graphics, or other video data. 

<e When data is shared between different scenarios of a single title, it is obviously necessary to move the laser beam 

LS from the common scene data to the non-common scene date during reproduction, i.e., to move the optical pickup to 
a different position on the DVD recording medium RCl . The problem here is that the time required to move the optical 
pickup makes it difficult to continue reproduction without creating breaks in the audio or video, i.e., to sustain seamless 
reproduction. This problem can be theoretically solved by providing a track buffer (stream buffer 2400) to delay data out- 

50 put an amount equivalent to the worst access time. In general, data recorded to an optical disk is read by the optical 
pickup, appropriately processed, and temporarily stored to the track buffer. The stored data is subsequently decoded 
and reproduced as video or audio data. 

S pecific Problem in Interleaving 

55 

The operation of the stream buffer 2400, or a track buffer, in this DVD system is described briefly below. 
Because rotational speed control of the optical disk drive cannot instantaneously adjust the disk speed, the input 
to the stream buffer 2400, i.e., the transfer rate Vr from the optical disk, is a basically constant rate. Output from the track 
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butler, i.e.. the tianstei rate Vo to the decoaei. however, vanei, according to the image quality, usei intent, and even the 
variable bit rate o1 the compressed video data in the DVD system. The 1rom-disk transler rate Vi is therefore constant 
at approximately 11 Mbps in the DVD system, while the transler rate Vo from the buffer is variable to a maximum 10 
Mbps. 

Because of this gap between the input and output transfer rates Vr and Vo. the stream buffer 2400 will overflow if 
data is transferred continuously from disk Theietore. to pi event the stream buffer 2400 of the reproduction apparatus 
overflowing, data is transferred intermittently fiom the disk. The stream buffer is controlled dunng normal continuous 
reproduction to always be in a near -overt low state. 

It is therefore possible by using a stream buffer 2400 to sustain continuous, uninterrupted data output (reproduc- 
tion) even if there is a slight break in data reading as a result ol the read head (optical pickup) 2006 jumping to move 
between logic sectors LS on the disk. In an actual reproduction apparatus, however, the jump time may vary between 
200 msec and 2 sec depending upon the distance and position on the disk M. While it is possible to use a stream butlei 
2400 with capacity sufficient to absorb this jump time, the compression bit rate is an average 4 - 5 Mbps and a maximum 
10 Mbps when using a large-capacity optical disk M storing high quality images. Assuring seamless reproduction when 
jumping from any disk position to any other with this system imposes significant memory requiiements. lesulting in an 
expensive decoder DC. Because the amount of memory that can be built in to the decoder DC is therefore limited if a 
cost-effective product is to be marketed, other limitations are imposed, e. g., limiting the jump time to a time whereby 
data can be continuously reproduced. 

The relationship between the accumulated data quantity in the stream buffer 2400 and the operating mode of the 
reading head 2006 is shown in Fig. 32. In Fig. 32. period Tr is the period during which the optical pickup reads data from 
the optical disk RC. and period Tj is the jump period during which the optical pickup moves between logic sectors. Line 
L1 expresses the change in data volume Vd stored in the stream buffer 2400 during the data read period Tr. Line L2 
expresses the change in data volume Vd stored in the stream buffer 2400 during the jump per iod Tj. 

During the data read period Tr. the reading head 2006 reads data from the optical disk M at the transfer rate Vr. and 
stores the read data directly to the stream buffer 2400 The str eam buffer 2400 supplies the data to the decoders 3801 . 
3100. and 3200 at the transfer rate Vo. As a result, data accumulates in the stream buffer 2400 during the data read 
period Tr at the rate Vr-Vo. i.e.. the difference between these two transfer rates. 

Because the reading head 2006 is moving to access a different disk position during the jump period Tj. data read 
from the optical disk M cannot be stored to the stream buffer 2400. Data continues to be output from the stream buffer 
2400 to the decoders 3801 . 3100, and 3200 during this period, however, and the accumulated data volume Vd remain- 
ing in the stream buffer 2400 decreases at the rate at which data is transferred to the decoders, i.e., transfer rate Vo. 

Note that while the transfer rate Vo to the decoders is shown in Fig. 32 as a constant rate, data transfers to the 
decoders actually occur intermittently because the decoding time varies according to the data type. These differences 
are omitted to simply this description of the buffer underflow concept. This is equivalent to the reading head 2006 read- 
ing data intermittently during the jump period Tj. even through the reading head 2006 continuously reads from the opti- 
cal disk M at a constant linear velocity (CLV). The slopes Li and L2 of lines Li and L2 above can be expressed by the 
following equations. 

LI = Vr - Vo [1] 
L2 = Vo (2] 

Underflow occurs, and decoding stops, when the jump period Tj is long enough for stream buffer 2400 to empty. If 
the jump period Tj is held to less than the time required for the stream buffer 2400 to empty, however, decoding can con- 
tinue without data interruptions. This time at which the reading head 2006 can jump to another disk position without a 
data underflow state occurring in the stream buffer 2400 is referred to as the jump-enabled time. 

Note that while physical movement of the reading head 2006 has been described as a factor causing a data under- 
flow state in the stream buffer 2400, the following factors also contribute. Note, further, that this data underflow state 
can be simply characterized as a condition in which data input to the track buffer (stream buffer 2400) does not keep 
pace with data output from the track buffer. 

a) The buffer is too small relative to the decoding speed of the decoder. 

b) The sizes of the individual input units of the plural VOB types carried in the reproduced bitstream St61 input to 
the stream buffer 2400 from the bitstream producer 2000 are inappropriate for the buffer size. 

c) The sequence of the individual input units of the plural VOE types carried in the reproduced bitstream St61 is 
inappropriate for the decoding speed, resulting in the next data unit to be decoded not being received in sufficient 
time while decoding a particular data unit. 
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When the reproducing apparatus ol the digital video dish system is configured with a disk read rate ot 1 1 Mbps. a 
maximum AV data compression late ol 10 Mbps. and a tiack butlei (stieam bullei 2400) capacity ol 4 Mbits. tot exam- 
ple, a data underflow state will occui. To pi event this data underflow state from occurring duiing the jump period Tj in a 
reproduction apparatus thus configured with slight overflow control maintained during normal continuous playback, a 

5 maximum jump-enabled time ot 400 msec can be assuied even in a worst -case scenario wheie 10 Mbps ot AV data is 
reproduced during the jump period. 

Note that a jump-enabled time ot 400 msec is a realistic value thai can be achieved in actual reproduction appara- 
tuses. In such an apparatus the distance that can be jumped during a 400 msec period is approximately 500 tracks. It 
follows that the jump-enabled time can also be deiined in dala quantity terms, specifically the volume of the sequential 

io data stream that the reading head 2006 can move through within the jump-enabled time. The data volume equivalent 
to a 400 msec jump-enabled time is approximately 250 Mbits. It will also be obvious that the actual distance in sector 
and track units on the recording medium can also be easily obtained from the data volume detined as the jumpable dis- 
tance based on the recording method and density of the recording medium. 

A 250-Mbrt jumpable distance is equivalent to a 50 sec. presentation time assuming AV data reproduced at an aver - 

is age 5 Mbits/sec. With even higher quality AV data, the presentation time is less than 50 sec. In movies and other data 
streams edited to remove particular scenes due to cultuial, educational, or other reasons, the excised scenes are typi- 
cally long, usually ranging from 2 to 5 minutes, and even as long as 10 minutes. If the excised scene lasts 5 minutes, 
for example, with the above reproduction apparatus, it is not possible to uninterruptedly connect the scenes before and 
after an excised scene if the before scene, excised scene, and after scene are recorded to disk in a single contiguous 

20 series. More specifically, the data corresponding to a continuous 5 minute scene cannot be jumped in a single jump 
operation. 

There are also cases in which the AV data compression rate, i.e., the consumption rate Vo of data from the track 
buffer, approaches 10 Mbps and non-occurrence of a buffer underflow state cannot be assured, even when the excised 
scene data is jumped using a jump period Tj exceeding 400 msec. While such a data underflow state can conceivably 

25 be avoided by recording two AV data scenarios, i.e.. excised (edited) and un-excised (unedited) scenarios, to disk, this 
method does not make effective use of the available disk capacity. If it is also necessary to record duplicate data for 
much presentation time, the AV data will be low quality and it will be difficult to satisfy most user expectations. 

The concept of sharing data between plural titles is described below with reference to Fig. 33 wherein TL1 and TL2 
refer to the data content of a first and second title, respectively. Specifically, the first title TL1 consists of data DbA, DbB, 

so and DbD reproduced contiguously during time T, and the second title TL2 similarly consists of data DbA, DbC, and DbD 
reproduced contiguously during time T. Note that data DbA, DbB. DbC, and DbD are video objects VOB with display 
times Tl, T2, T2, and T3, respectively. When two titles TL1 and TL2 thus comprised are recorded to disk, the data 
stream is structured with data DbA and DbD as shared data of both titles TL1 and TL2, and data DbB and DbC as the 
discrete data of titles TL1 and TL2, respectively, selectively reproduced during selection period T2 as shown by title 

35 TL1_2. Note that while there appears to be a time gap between the data blocks in Fig. 33. this is simply to facilitate the 
use of arrows in the figure for easier description of the data reproduction paths. There is no actual time gap during play- 
back. 

The format whereby these data blocks DbA. DbB, DbC, and DbD are recorded to disk in title TL1_2 to enable con- 
tiguous reproduction of the data is shown in Fig. 34. In principle, data blocks DbA, DbB, DbC, and DbD composing a 

<o single contiguous title are recorded to contiguous segments of the data recording track TR (Fig. 9). Thus, data DbA, 
DbB, and DbD of first title TL1 are first recorded contiguously, and are followed by data DbC unique to the second title 
TL2. With this data format, the first title TL1 can be contiguously reproduced without breaks in the title content, i.e., 
seamlessly, by means of controlling the reading head 2006 to access data DbA, DbE, and DbD synchronized to play- 
back periods T1 , T2, and T3, respectively. 

45 To reproduce the second title TL2, however, the reading head 2006 must jump past data DbB and DbD after repro- 

ducing data DbA in period Tl, and must reach data DbC before the start of period T2 as shown by arrow Sq2a in Fig. 
34. Then after reproducing data Dbc, the reading head 2006 must jump back to data units DbC and DbD as shown by 
arrow Sq2b, and reach data DbD before the start of period T3. Because of the time required to move the reading head 
2006 between data blocks, it is not possible to assure seamless reproduction between data DbA and DbC, and between 

50 DbC and DbD, unless the distance traveled between these data blocks requires less time than the time required for a 
data underflow state to occur in the stream buffer 2400. 

Definition of Interleaving 

ee To thus enable the user to selectively excise scenes and choose from among plural scenes, a state wherein non- 
selected scene data is recorded inserted between common scene data and selective scene data necessarily occurs 
because the data units associated with individual scenes are contiguously recorded to the recording tracks of the 
recording medium. If data is then read in the recorded sequence, non-selected scene data must be accessed before 
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accessing and decoding the selected scene data, and seamless connections with the selected scene is difficult. The 
excellent random access chaiactenslics ot the digital videc disk system, howevei. make seamless connections with the 
selected scenes possible 

In othei words, by splitting scene- specific data into plural units ol a specitied data size, and interleaving plural split 
data units loi ditlerent scenes in a predefined sequence that is recorded to disk within the jumping range whereby an 
data underllow state does not occur, it is possible to reproduce the selected scenes without data interruptions by inter- 
mittently accessing and decoding the data specrtic to the selected scenes using these split data units. Seamless data 
reproduction is thereby assured. 

Detailed Definition of Interleaving 

The seamless connection method and data splitting and arraying concepts oi the present invention are described 
below using the track butler input transfer rate Vr and data consumption rate Vo described above. 

Referring again to Fig. 32, the data consumption rate Vo is less than the tr ansfer rate Vr (Vr > Vo). Using this differ- 
ence, a known data volume is read at the tianster rate Vr. buffer ed to the track buffer and stored, and is then consumed 
(output to the decoder) while the optical pickup moves to the position of the next read data. To pi event a data underflow 
state even after multiple repetitions of this operation, split data units for a defined volume of data for each scene are 
distributed at an appropriate interval. This method of arraying data to assure seamless data reproduction is called 
"interleaving." the split data units of a size sufficient for buffering to the track buffer are called "interleave units," and the 
interleave units after interleaving are called "interleaved units." 

When one scene is selected from plural scenes, interleave units are required for the plural video objects VOBs 
composing those plural scenes. Two interleaved units ILVU contiguous on the time-base and belonging to the selected 
scene are separated by one or more interleaved units ILVU belonging to another scene inserted therebetween. The dis- 
tance between two time-base-contiguous interleaved units ILVU belonging to the same scene is defined as the inter- 
leave distance. 

For example. 260 msec is required to move 10.000 sectors using an optical disk recording medium. If this 10.000- 
sector movement of the optical pickup is the interleave unit distance, the size of the interleaved units ILVU can be deter- 
mined from the difference between the track buffer input and output transfer rates Vr and Vo. and the size of the track 
buffer. Let us assume, for example, that compressed data is being output at a constant rate using an input transler rate 
Vr o1 n Mbps and an output transfer rate Vo of 8 Mbps, and a track buffer capacity of 3 Mbits. If the distance between 
interleaved units ILVU is 1 0,000 sectors, there must be enough interleaved units ILVU to input to the track buffer to accu- 
mulate therein a 260-msec equivalent of playback data before the reading head moves. 

In general. 2080 Kbits is equivalent to 260 msec of playback data. To store this much data to the track buffer before 
moving between interleaved units ILVU, source data must be input to the track buffer for 0.7 sec. at the difference 
between transfer rates Vr and Vo (= 2080 Kbit/(1 1 -8) Mbits/sec). The time needed to read enough source data from the 
recording medium M to store sufficient data to the track buffer to provide for data consumption by the decoder while the 
optical pickup is moving to the target interleaved unit ILVU and can resume data reading is defined as the minimum 
accumulation read time. 

The minimum interleaved unit size, i.e., the amount of data that must be read, is therefore 7.7 Mbits. Converted to 
presentation time, this makes it possible tc interleave units with a presentation time of 0. 96 sec. or greater with pres- 
entation time intervals less than 20 sec. between interleaved units. By reducing the system stream consumption bit rate, 
the minimum accumulation read time can be reduced, and the size of the interleaved units can be reduced. It is also 
possible to increase the jumpable time without changing the interleaved unit size. 

One method of connecting scenes is shown in Fig. 35 where the following scenarios are possible: scene A con- 
nected to scene D; scene A connected to scene B, which is substituted for a certain time segment of scene D; and 
scene A connected to scene C ( which is similarly substituted for a certain time segment of scene D but for a different 
time segment than scene E. In such cases, scene D is further blocked into scene segments (scenes) D-1, D-2, and D- 
3. The system stream corresponding to scenes B, D-1, C. and D-2 is the output system stream output at transfer rate 
Vo (= 8 Mbps). Data is input to the track buffer at transfer rate Vr (= 11 Mbps) in the scene sequence B. D-1 , C, D-2; the 
data size of each scene is greater than the above value (= 0,96 sec.), and can be arrayed within the distance that can 
be jumped between connected scenes as described above. 

However, when scenes with the same starting points but different end points, e.g., scenes B. C, and D in this exam- 
ple, are interleaved, three different system streams become interleaved during the period corresponding to scene D-1 , 
two system streams become interleaved during the period corresponding to scene D-2. and processing tends to 
become complex. It is therefore more common when interleaving plural videc objects VOB to interleave objects having 
the same starting and end points, thus simplifying processing. This can be accomplished as shown in Fig. 36 by copy- 
ing and appending scene D-2 to scene C of Fig. 35. thereby unifying the points at which plural scenes diverge and con- 
nect, i.e., the starting and end points, with plural interleaved video objects VOB. When interleaving branching and 
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connecting scenes in the digital video disk system, therefore, the scenes aie interleaved with the starting and end 
points theieol aligned. 

The interleaving concept is described in turthei detail below. 

The audio- video (AV) system stieam desciibed above is one example of interleaving with time information. This 
5 interleaving method anays audio and video inloimation having the same time-base so that data input to the bufler at 
approximately the same time is in physical proximity, and data units having approximately the same presentation time 
are arrayed in alternating sequence. When one scene can be replaced with anothei scene in titles such as movies, 
however, the time between these plural scenes often differs. When the AV system stream interleaving method 
desa ibed above is applied in such cases, the betweenscene time diflei ence can be absorbed by the buffer ii it is within 
io the jumpabJe time. If the between-scene time difference is greater than the jumpable time, however, the buffer cannot 
absorb the difference and seamless playback is not possible. 

It the track butter size is increased to inctease the amount of data that can be accumulated at one time, a longer 
jumpable time is obtained, and the interleave unit and sequence are more easily determined. When interactive opera- 
tion enabling the user to select fiom among plural scenes (e.g., multi-angle scenes) with seamless playback, the pres- 
15 entation time of the previous angle stream is increased after the angle (stieam) is changed if the interleaved units ILVU 
are made longer and the amount of data stored at one time is increased. This also lesults in more time being required 
for the displayed stream to change. 

Interleaving is thus the process of optimizing the system stream arrangement in data block units to prevent a data 
underflow state from occurring in the track buffer of the authoring decoder DC when the encoded data supplied from 
20 the stream source is consumed for decoding by the decoder. 

A major cause of this data underflow state is the mechanical movement of the optical pickup, though there are 
lesser factors such as the decoding speed of the communications (decoding) system. Mechanical movement of the 
optical pickup is a problem when the optical pickup scans the data recording track TR of the optical disk M to read data. 
Interleaving is also needed when recording the data to the data recording track TR of the optical disk M. The decoding 
25 speed of the communications system can also become a problem when the source stream is supplied directly as occurs 
with live broadcasts, cable television and other dedicated line transmissions, broadcast satellites and other radio wave 
transmissions, and other means whereby title content is not reproduced from a recording medium on the user's side. In 
such cases the transmitted source stream must be interleaved. 

Interleaving can thus be more specifically defined as the process wher eby the data carried in a source stream com- 
30 prising source data groups of plural contiguously input source data blocks is arranged in a particular sequence whereby 
the desired (targeted) source data can be intermittently and sequentially accessed to contiguously reproduce the infor- 
mation in the targeted source data. The duration of these intermittent breaks in the input of the target source data that 
is to be reproduced is therefore defined as the jump time of the interleave control. 

It should be noted, however, that an interleaving method for arraying on a random access disk movies and other 
35 common titles containing scene selections that may branch and recombine according to various scenarios in a manner 
whereby video objects VOB containing video data compressed with variable length coding has not been described. 
When arraying this type of data to disk, a certain amount of trial and error is required using the compressed data. This 
obviously makes it necessary to define an interleaving method tor arranging plural video objects in a sequence enabling 
seamless playback. 

40 When applied to a DVD system as described above, these video objects are distributed to positions (navigation 
packs NV) within a specific time-base range bounded by GOP units, the unit of video data compression. The GOP data 
length, however, may vary as a result of user -defined image manipulation processes or intra-frame coding inserted for 
higher image quality. This means that the location of the management packs (navigation packs NV), which are depend- 
ent upon the presentation time, can vary. This means that the point at which the scene angle changes or the optical 

45 pickup jumps to the next data block in the playback sequence is indefinite. Furthermore, if plural scene angles are inter- 
leaved together, the length of contiguously read data is indefinite even if the next jump point is known. Thus, the data 
end point position is known only after the next angle data is read, and switching the playback data is thus delayed. 

The present invention therefore provides a method and apparatus enabling seamless data reproduction using an 
optical disk having a data structure whereby data is shared between plural titles to efficiently utilize the available optical 

so disk space, and a new function called "multi-angle scene reproduction" is achieved. The method and apparatus of the 
present invention are described below with reference to the accompanying figures. 

Interleaved block and Interleave unit 

55 The interleaving method enabling seamless data reproduction according to the present invention is described 
below with reference to Fig. 24 and Fig. 37. Shown in Fig. 24 is a case from which three scenarios may be derived, i.e., 
branching from one video object VOB- A to one of plural video objects VOB-E, VOB-C, and VOB-D, and then merging 
back again to a single video object VOB-E. The actual arrangement ol these blocks recorded to a data recording track 
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TR on disk is shown in Fig. 37. 

Refeinng to Fig. 37. VOB-A and VOB-E aie video objects with independent playback start and end times, and aie 
in principle anayed to contiguous block reg;ons As shown in Fig 24. the playback start and end times of VOB-B. VOB- 
C. and VOB-D are aligned during intei leaving The interleaved data blocks are then recorded to disk to a contiguous 
interleaved block region. The contiguous block legions and interleaved block regions are then wntten to disk in the track 
path Di direction in the playback sequence. Plural video objects VOB. i.e.. interleaved video objects VOBS. arrayed to 
the data recording track TR are shown in Fig. 37 

Referring to Fig 37. data regions lo which data is continuously arrayed are called "blocks." ol which there are two 
types 'contiguous block legions" in which VOB with disciete starting and end points are contiguously arrayed, and 
"interleaved block regions" in which pluial VOB with aligned starting and end points are interleaved. The respective 
blocks are arrayed as shown in Fig 38 in the playback sequence, i.e.. block 1. block 2. block 3. . . . block 7. 

As shown m Fig 38 the VTS title VOBS (VTSTl_VOBS) consist ot blocks 1 - 7. inclusive. Block 1 contains VOB 1 
alone Stocks 2. 3 5 and 7 similarly discretely contain VOBS 2. 3. 6. and 10. Blocks 2. 3. 5. and 7 are thus contiguous 
brfock regions 

Block 4 howeve* contain* VOB 4 and VOB 5 intei leaved togethei, while block 6 contains VOB 7. VOB 8. and VOB 
9 interleaved togettiei Bkxks 4 and 6 aie thus interleaved block legions. 

The internal data sttuciue o* the contiguous block regions is shown in Fig. 39 with VOB-i and VOB-j arrayed as the 
contiguous blocks m tn* VOBs As described with reference to Fig. 16. VOB-i and VOB-j inside the contiguous block 
regions are fur the* (og*ca)>> cvvdoo mio ceils as the playback unit. Both VOB-i and VOB-j in this figure are shown com- 
prising three cells CELL »i CI Li *? and CELL £3 

-Each cell compi iset on« o ~x>« *o*o object unit VOBU with the video object unit VOBU def ining the boundaries 
of the cell Each cell aKc contain "uion oentif ying the position of the cell in the program chain PGC (the playback 
control information ol tr*» o>t> **>*c o%> v^stenn). More specifically, this position information is the address of the first 
and last VOBU in the crt w ^r»~**^ m f wj 39. these VOB and the cells defined therein are also recorded to a con- 
tiguous block region so ttw c nr^i>*>*. r*ocx^ are contiguously reproduced. Reproducing these contiguous blocks is 
therefore no problem 

The internal data stmcajr • o* «rce«ieaved olock regions is shown in Fig. 40. In the interleaved block regions each 
video object VOB is c*w3«c! r*r. **<**saved units ILVU. and the interleaved units ILVU associated with each VOB are 
alternately arrayed Cen txxm*'m a*e aetmed independently of the interleaved units ILVU. For example. VOB-k is 
divided into tour interleaved u^*ts i !LVUk2, I LVUk3. and I LVUk4, and are confined by a single cell CELL#k. VOB- 

k is likewise divided into kxp ^te^e^ed units ILVUrnl , ILVUm2, ILVUm3, and ILVUm4, and is confined by a single cell 
CELL*m Note that msteac o* a &jnpe cell CELL#k or CELL#m. each of VOB-k and VOB-m can be divided into more 
than two cells. The inter ea/«c ur<ts ILVU thus contains both audio and video data. 

In the example srx>wn *i f ^ ac trie interleaved units ILVUkl , ILVUk2. ILVUk3, and ILVUk4, and ILVUrnl , ILVUm2. 
ILVUm3. and ILVUmc. trorr n«c c*«e*en video objects VOB-k and VOB-m are alternately arrayed within a single inter- 
leaved block. By interleaving T>e meieaved units ILVU of two video objects VOB in this sequence, it is possible to 
achieve seamless reproduction branching from one scene to one of plural scenes, and from one of plural scenes to one 
scene. This interleaving proems turmer enables seamless reproduction of scenes from various scenario threads in 
most cases 

An alternative tor achie v ing jr»e*ie avina 

Seamless repioduc:io^ is w»> possible when there are three possible scenario threads as shown in Fig. 35, i.e., 
from scene A to scene B ancj t^*-n to scene D-3 starting at some midpoint in scene D; from scene A to the beginning 
of scene D; and from scene a to scene C. and then to scene D-2 starting at a midpoint in scene D different from D-3. 
As shown in Fig. 36. it is also posstfx? tr> connecting before and after scenes (scene D-2) to align the starting and end 
points according to the data stmrtue ot me present invention. Note that this process of copying scenes to align the 
starting and end points makes. «t poc-si^e to seamlessly reproduce even complicated threading of different scenes. 

An interleaving algorithm com pat Qe wrth variable length coded data 

An example of an interleaving algorithm compatible with variable length coded data, i.e., video data, is described 
next. 

When plural VOB are mterteavec each VOB is basically divided into the same particular number of interleave units. 
It is also possible to obtain the oaia volume (size) ol each of this particular number of interleave units based on the bit 
rate of the VOB to be interleaved the jump time and distance that can be jumped within this jump time, the track buffer 
capacity and the input rate Vr to the tiack butler, and the position of the video object unit VOBU. Each interleaved unit 
consists of video object units VOBU. each ol which comprises one or more MPEG GOP with a data quantity equivalent 
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to a 0.4 - 1 .0 second presentation time 

When data is interleaved, the interleaved units ILVU forming separate video objects VOB are alternately arrayed. II 
any o1 the plural interleave units interleaved to the shortest oi plural VOB is shorter than the minimum interleave unit 
length, or it the total length oi plural interleave units in any but the shortest ot plural VOB. is greater than the shortest 
i interleave distance, an underflow state will occui when this shortest interleave VOB is reproduced, and non-seamless 
reproduction will result instead oi seamless reproduction. 

Belore encoding occurs in the present embodiment it is theretore determined whether interleaving is possible. 
Whether interleaving is possible can be determined trom the lengths oi the pre-encoded streams. Because the ellect 
o1 interleaving can thus be determined in advance, the need lor data reprocessing, i.e.. the need to adjust the interleav- 
w ing conditions and record after interleaving and encoding are once completed, can be prevented. 

The interleaving method tor recording to an optical disk according to the present invention is described specifically 
below, starting whh the bit rate ot the recorded VOB and the performance and other conditions ot the reproduced disk. 

When interleaving is applied, the relationship between the track butler input transfer rate Vr and output tiansler rate 
Vo is delmed as Vr > Vo as previously described. The maximum bit rate of each VOB to be interleaved is therefore set 
?5 to less than the track buffer input transfer rate Vi. The maximum bit rate B ot each VOB is therefore set to a value less 
than Vi If in the evaluation deter mining whether interleaving enabling seamless reproduction is possible it is assumed 
that all plural VOB to be interleaved are encoded with constant bit rate (CBR) coding at the maximum bit rate, the inter- 
leave unit cata volume is maximized, the time that can be reproduced from the data volume that can be placed at the 
jumpofc*'? distance is shortened, and the interleave conditions are stringent. 
20 Hole tnat rt tc assumed below that each VOB is encoded with constant bit rate (CBR) coding at the maximum bit 

rate 

i* \% as.i**"«3 m the following description of the reproduction apparatus that the distance the optical pickup can 
jump *tir*n Yjmc time JT expressed as a data quantity is jumpable distance JM, and the input data bit rate to the 
trar* r*d*« n# rffw nrtuction apparatus is BIT. 

25 i" iw^ri an reproduction apparatus, the disk jump time JT is 400 msec, the jumpable distance JM is 250 

Mr*! -n r>\. br^* J' The maximum bit rate B of the VOB in the MPEG system is defined as 8.8 Mbps considering 
that a*i* t mur »s 'equired to obtain image quality superior to that of a conventional VCR recording. 

(vivmi ^ r*#-vdf*e distance JM. jump time JT. and data read times from disk, the target values for the smallest 
irr^i-si.^ ^rv? n rjv and the smallest interleave unit presentation time ILVUMT are calculated first. The smallest 

so in-— pt»- J ^t^-jor time ILVUMT can be obtained from equation 3. and the smallest interleaved unit size ILVUM 
cvi'- 1~ -jf Htj^otion 4 below. 

ILVUMT > JT + ILVUM/BIT [3] 

35 ILVUMT x B = ILVUM [4] 

* <on- «>^cr ? vnaiiest interleave unit presentation time ILVUMT is determined to be 2 sec, and the smallest 
t»oo c^a-^ uM n, i * t> MDrt Thus, il the smallest interleave unit, which is the smallest unit of the data layout, is a 
e-^u^a*-^ ar-a 2^^y and each GOP comprises 15 frames (NTSC format), then the smallest interleave unit is 
<o eour»a»«ot to oat* eo in tour GOP. 

Ai» ai'jc statec afxov* one interleaving condition is that the interleave distance be less than or equal to the jumpable 
distance 7^ n^rr, pw: e»cep: for the VOB with the shortest presentation time, the total presentation time of plural 
VOB to «vti*.n •Mt.-*i«viiy applied must be shorter than the time that can be reproduced within the interleave dis- 
tance n as m tr»e aocvc sample the jumpable distance JM is 250 Mbit and the maximum VOB bit rate is 8.8 Mbps, the 
<t time JMT that car t* »eo»couced with the data quantity read within the jumpable distance JM is 28.4 sec. It is then pos- 
sible to calculate an intetteavaWe conditions equation using these values. If each VOB in the interleaved block region 
is divided into mo ymo number of interleaved block and this number of interleaved divisions is v, equation 5 can be 
obtained from the conononc of the smallest interleave unit length. 

so (presentation time of shortest VOB)/ILV UMT < v (5] 

Equation 6 can then also be obtained from the jumpable presentation time conditions. 

v < (presentation time of all VOB except shortest VOB)/JMT 16] 

Plural VOB can in principle be interleaved if the above conditions are fulfilled. In practical terms. VOBU compensa- 
tion to the value calculated according to the above equations is necessary because the interleave units are limited to 
the VOBU boundaries. 1o compensate equations 2, 3. and 4, it is necessary to add the maximum VOEU time (1. 0 sec.) 
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to the smallest mtei leave unit pieseniation time IIVIJM7. and reduce the presentation time in the interleave distance 
JMT by the maximum VOBU time 

It it is detei mined that an interleaved sequence enabling seamless playback is not possible as a result of calculating 
the conditions tor mtei leaving the VOB scenes betoi e encoding, it is necessar y to inci ease the number of interleave unit 
divisions This means increasing the length ol the scene forming the shortest VOB by moving the scene therebeforeor 
after. It is also necessary to add the same scene added to the shortest scene to the other scenes. In general, the inter- 
leave distance is significantly greater than the shortest interleave unit, and the rate ol increase in the value on the left 
side of equation 4 is greater than the increase in the value on the right side of equation 6. As a result, increasing the 
size of the shitted (moved) scene can lesult in satisfying the above conditions. 

The track buffer input transfer rate Vi and output transfer rate Vo must be in the relationship Vr > Vo as described 
above tor the data in the interleaved blocks The optical pickup may also jump immediately after entering an interleaved 
block region from a contiguous block region, in which case rt is also necessary to store the data from immediately before 
the interleaved block region. This makes it necessar y to suppress the bit rate of part of the data in the VOB immediately 
before the interleaved block region. 

It is also possible that the optical pickup may jump immediately aftei enter ing an inter leaved block from a contigu- 
ous block, in which case it is necessary to suppress the maximum bit rate ol the contiguous block immediately before 
the interleaved block, and store the data from immediately before the interleaved block to the track buffer. The target for 
suppressing the maximum bit rate. i.e.. the amount the maximum bit rate is suppressed, is the presentation time of the 
shortest interleave unit, which can be calculated from the maximum bit rate of the interleaved block reproduced after 
the contiguous block. 

Note that while the above operation has assumed that all VOB are divided into the same number of interleave units, 
it is also possible to group the VOB into a group of VOB containing u divisions (interleave units) and a group of VOB 
containing u+1 divisions when there is a significant difference in VOB length. 

This can be accomplished by defining the minimum number of divisions in each VOB obtained from equation 5 as 
u and using this value u for all VOB from which a greater number of interleave units cannot be obtained, and using the 
number of interleave units obtained from equation 4 up to (u + 1) for larger VOB. This is illustrated in Fig. 41. 

The data structure of the interleaved unit ILVU in another embodiment of the invention is shown in Fig. 42. In this 
structure the navigation pack NV described with reference to Fig. 20 is placed at the beginning of each video object unit 
VOBU. and the data from one navigation pack NV to immediately before the next navigation pack NV is defined as one 
video object unit VOBU. The video object unit VOBU boundaries determine the boundaries of the interleaved unit ILVU, 
each of which is longer than the length of the shortest interleaved unit, which is obtained from the decoder performance, 
bit rate, and other considerations using equations 5 and 6. 

Each of the component video object units VOBU contains a navigation pack NV (management information -pack), 
each navigation pack NV containing an ILVU end pack address ILVU_EA indicating the address of the last pack in the 
ILVU to which the VOBU belongs, and the next- ILVU start address NTJLVU_SA. The position to which the start 
address NT_ILVU_SA points is the address of the first pack (NV) in the next interleaved unit ILVU to be reproduced, 
while the ILVU end pack address ILVU_EA points to the end position of the interleaved unit ILVU containing the end 
pack address ILVU_EA. Note that as previously described these addresses are expressed as the number of sectors 
from the navigation pack NV containing the address information. 

When a video object unit VOBU is in an interleaved block region, the next-ILVU start address NTJLVU_SA points 
to the start address of the next ILVU. similarly expressed as the number of sectors from the navigation pack NV con- 
taining the address information. 

It is therefore possible after reading the first navigation pack NV data in the interleaved unit ILVU to obtain the loca- 
tion of the next interleaved unit ILVU to be reproduced, and to what disk position the current interleaved unit ILVU is writ- 
ten. This makes it possible to only read the interleaved units ILVU. and to smoothly jump to the next interleaved unit 
ILVU. 

Multi-scene control 

The multi-scene period is described together with the concept of multi-scene control according to the present 
invention using by way of example a title comprising scenes recorded from different angles. 

Each scene in multi-scene control is recorded from the same angle, but may be recorded at different times or may 
even be computer graphics data. The multi-angle scene periods may therefore also be called multi-scene periods. 

Parental control 

The concept of recording plural titles comprising alternative scenes for such functions as parental lock<x>ntrol and 
recording director s cuts is described below using Fig. 43. 
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An example ol a multi- rated lille sti earn providing lor pai ental lock control is shown in Fig. 43. When so-called "adult 
scenes** containing sex. violence, oi othei scenes deemed unsuitable loi children are contained in a title implementing 
parental lock control, the title stieam is lecoided with a combination of common system streams SSa. SSb. and Sse. 
an adult -oriented system stream SSc containing the adult scenes, and a child-oriented system stieam SSd containing 

c only the scenes suitable foi children. Title streams such as this aie lecoided as a multi-scene system stream containing 
the adult-oriented system stream Ssc and the child-oriented system stream Ssd arrayed to the multi-scene period 
between common system streams Ssb and Sse. 

The relationship between each ol the component titles and the system stream recorded to the program chain PGC 
ot a title stream thus comprised is described below. 

10 The adult-oriented title program chain PGCl comprises in sequence the common system streams Ssa and Ssb. 

the adult-oriented system stream Ssc. and the common system stream Sse. The child-oriented title program chain 
PGC2 comprises in sequence the common system sir earns Ssa and Ssb. the child -oriented system stieam Ssd. and 
the common system stream Sse. 

By thus arraying the adult-oriented system stieam Ssc and child-oriented system stieam Ssd to a multi-scene 

75 period, the decoding method previously described can repioduce the title containing adult-oiiented content by repro- 
ducing the common system streams Ssa and Ssb. then selecting and reproducing the adult-oriented system stieam 
Ssc. and then reproducing the common system stream Sse as instructed by the adult-oiiented title program chain 
PGCL By alternatively following the child-oriented title program chain PGC2 and selecting the child-oriented system 
stream Ssd in the multi-scene period, a child-oriented title from which the adult-oriented scenes have been expurgated 

20 can be reproduced. 

This method of providing in the title stream a multi-scene period containing plural alternative scenes, selecting 
which ol the scenes in the multi-scene period are to be reproduced before playback begins, and generating plural titles 
containing essentially the same title content but different scenes in part, is called parental lock control. 

Note that parental lock control is so named because of the perceived need to protect children from undesirable con- 
25 tent. From the perspective of system stream processing, however, parental lock control is a technology for statically 
generating different title streams by means of the user pre-selecting specific scenes from a multi-scene period. Note, 
further, that this contrasts with multi-angle scene control, which is a technology for dynamically changing the content ol 
a single title by means of the user selecting scenes from the multi-scene period freely and in real-time during title play- 
back. 

30 This parental lock control technology can also be used to enable title stream editing such as when making the 

director's cut. The director's cut refers to the process of editing certain scenes from a movie to, for example, shorten the 
total presentation time. This may be necessary, for example, to edit a feature-length movie for viewing on an airplane 
where the presentation time is too long for viewing within the flight time or certain content may not be acceptable. The 
movie director thus determines which scenes may be cut to shorten the movie. The title can then be recorded with both 

as a full-length, unedited system stieam and an edited system stream in which the edited scenes are recorded to multi- 
scene periods. At the transition from one system stream to another system stream in such applications, parental lock 
control must be able to maintain smooth playback image output. More specifically, seamless data reproduction whereby 
a data underflow state does not occur in the audio, video, or other buffers, and seamless information reproduction 
whereby no unnatural interruptions are audibly or visibly perceived in the audio and video playback, are necessary. 

40 

Multi-anale control 

The concept of multi-angle scene control in the present invention is described next with reference to Fig. 44. In gen- 
eral, multimedia titles are obtained by recording both the audio and video information (collectively 'recording" below) of 

45 the subject over time X The angled scene blocks #SCl... #SM1, #SM2, #SM3, and #SC3 represent the multimedia 
scenes obtained at recording unit times Tl, T2, and T3 by recording the subject at respective camera angles. Scenes 
#SM1 , #SM2, and #SM3 are recorded at mutually different (first, second, and third) camera angles during recording unit 
time T2, and are referenced below as the first, second, and third angled scenes. 

Note that the multi-scene periods referenced herein are basically assumed to comprise scenes recorded from dif- 

50 ferent angles. The scenes may, however, be recorded from the same angle but at different times, or they may be com- 
puter graphics data. The multi-angle scene periods are thus the multi-scene periods from which plural scenes can be 
selected for presentation in the same time period, whether or not the scenes are actually recorded at different camera 
angles. 

Scenes #SCl and #SC3 are scenes recorded at the same common camera angle during recording unit times Tl 
55 and T3, i.e., before and after the multi-angle scenes. These scenes are therefore called "common angle scenes." Note 
that one of the multiple camera angles used in the multi-angle scenes is usually the same as the common camera 
angle. 

To understand the relationship between these various angled scenes, multi-angle scene control is described below 
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using a live broadcast of a baseball game foi example only 

The common angle scenes #SCl and #SC3 are lecorded at the common camera angle, which is here defined as 
the view 1rom center held on the axis thiough ihe pitcher, battel, and catchei 

The lirst angled scene #SMl is recoided at the lust multi-camera angle. 1 1 . the camera angle 1rom the backstop 
on the axis thiough the catcher, pitchei. and batter The second angled scene #SM2 is recorded at the second mult- 
camera angle, i.e.. the view Irom centei field on the axis thiough the pitchei. battel, and catcher. Note that the second 
angled scene #SM2 is thus the same as the common camera angle in this example It thetelore follows that the second 
angled scene #SM? is the same as the common angle scene #SC2 recorded dining lecoiding unit time T2. The third 
angled scene #SM3 is lecoided at the thud multi-camera angle, i.e., the cameia angle from the backstop focusing on 
the infield. 

The piesentation times of the multiple angle scenes #SMl , £SM2. and #SM3 overlap in recording unit time T2; this 
period is called the 'multi-angle scene penod." By tieely selecting one of the multiple angle scenes #SM1, #SM2, and 
#SM3 in this multi-angle scene period, the viewei is able to change his 01 hei vii tual viewing position to enjoy a different 
view of the game as though the actual camera angle is changed. Note that while theie appeals to be a time gap 
between common angle scenes #SCl and #SC3 and the multiple angle scenes #SM1 , #SM2, and #SM3 in Fig. 44, this 
is simply to facilitate the use of anows in the figure foi easiei description of the data reproduction paths reproduced by 
selecting different angled scenes. There is no actual time gap during playback. 

Mutt.- angle scene control of the system stream based on the present invention is described next with reference to 
Fig 23 t-om the perspective of connecting data blocks. The multimedia data corresponding to common angle scene 
#SC is ietc*eoccc ac common angle data BA, and the common angle data BA in recording unit times Tl and T3 are 
referenced at BAi and BA3. respectively. The multimedia data corresponding to the multiple angle scenes #SMl, 
#SMZ arx3 *SM3 a»e referenced as first, second, and third angle scene data MAI, MA2, and MA3. As previously 
descntxo »e«e»ence to Fig. 44. scenes from the desired angled can be viewed by selecting one of the multiple 
angip rut* ma - MAP. and MA3. There is also no time gap between the common angle data BAI and BA3 and 
the nw*r»«» any* oata uruts MAT . MA2. and MA3. 

in <y «r> MPEG system stream, however, intermittent breaks in the playback information can result 

betwe«"«- m* »«procx#;ec common and multiple angle data units depending upon the content of the data at the connec- 
tion b€^»wo tr*> v4-Mt-c!«d nuitple angle data unit MAl , MA2. and MAS and the common angle data BA {either the first 
comntr *nQw» osta i before the angle selected in the multi-angle scene period or the common angle data BA3 fol- 
lowing sr * *n«;f <*-<«r:ed tn the multi-angle scene period). The result in this case is that the title stream is not naturally 
rep»axxf<: * ±f>?e ccm»guous title, i.e.. seamless data reproduction is achieved but non-seamless information 
reprcouito^ 

Tn*. rrvut. unr?* v^^ct cm process whereby one of plural scenes is selectively reproduced from the multi-angle 
seen* r^*cc3 mrr- j^-irm*-^ «morrnation presentation to the scenes before and after is described below with application 
in a d>g*^ .tvc o>?> s^J^n using Fig. 23 

C^-vy-ig th> ^cer* angle, i e., selecting one of the multiple angle data units MAI , MA2, and MA3, must be com- 
pleted be*>e rao ycxjcbon erf trie preceding common angle data BAI is completed. It is extremely difficult, for example, 
to criange to a orrv^e^ angje data unit MA2 during reproduction of common angle data BAI . This is because the mul- 
timedia oata r*as a *a-ar>e length coded MPEG data structure, which makes it difficult to find the data break points 
(bounaar*e*>) *~ me se*ecieo data blocks. The video may also be disrupted when the angle is changed because inter- 
frame caseations a»e usee m me coding process. The group_of _pictures GOP processing unit of the MPEG standard 
contain^ at ea^t on* n»t!tn>n hame. and closed processing not referencing frames belonging to another GOP is possi- 
ble witntri GO^ p»OCt~»5><ng unit. 

In otne* wendi »f me desired angle data. e. g.. MAS. is selected before reproduction reaches the multi-angle scene 
period, and at me latest b> me time reproduction of the preceding common angle data BAT is completed, the angletJata 
selected from witnm me mufi»-angle scene period can be seamlessly reproduced. However, it is extremely difficult while 
reproducing one angte to select and seamlessly reproduce another angle within the same multi-angle scene period. It 
is therefore difficurt when m a multi-angle scene period to dynamically select a different angle unit presenting, for exam- 
ple, a view from a drtierem camera angle. 

The method of switching between scene angles within a multi-angle scene period is described in further detail 
below with reference to Fig 76. Fig 77. and Fig 45 based on the digital video disk data structure described above. 

Fig 76 shows the presentation times of the smallest angle switching units in each of the multiple angle-data units 
MAl . MA2, and MA3 shown in Fig. 23. Within the context of the digital video disk system, the multiple angle data units 
MAl. MA2. and MA3 are the title editing units, i.e.. the video objects VOE. Each multiple angle data unit (VOB) com- 
prises plural (three in this example) interleave units ILVU as the smallest possible angle switching unit. Note that each 
interleaved unit ILVU thus contains a particular number of GOP The first angle data MAI thus contains angle switching 
units A51 , A52. and A53. 

The angle switching units A5i , A52, and A53 of the first angle data MAl have presentation times of 1, 2, and 3sec- 
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onds. respectively, lesutting in the first angle data MAI having a total presentation time pi 6 sec. The second angle data 
MA2 similarly comprises angle switching units B51 . B52. and B53 with presentation times ol 2, 3. and 1 second, respec- 
tively, and Die third angle data MAS comprises angle switching units C5i. C52, and C53 with presentation times ol 3, 
i . and 2 seconds, respectively. It should be noted that while the angle data MAi . MA2. and MA3 each has a 6 sec. pres- 

* entation time, the presentation time can obviously be set to various other particular values. 

The following example describes switching to and beginning the presentation o1 another (next) angle view while 
reproducing any particular interleave unit. For example, if the angle is changed from lirst angle data MAI to second 
angle data MA2 while reproducing interleave unit A51 . reproduction of interleave unit A51 stops and reproduction ol the 
second interleave unit B52 in the selected second angle data MA2 starts. This change intermits both the audio and 

w video presentation, resulting in non-seamless information presentation. 

Likewise, it the user chooses to switch to Ihe scene corresponding to the third angle data MA3 during reproduction 
of the second interleave unit B52 in the second angle data MA2. reproduction o1 interleave unit B52 stops and repro- 
duction ol interleave unit C53 star ts. This operation again intermits both the audio and video presentation, resulting in 
non-seamless information presentation. 

75 Note that in the above cases switching between multiple angle data dui ing data reproduction stops reproduction of 

the angle being piesented. and seamless information presentation, i.e.. presentation without intermitting the audio and 
video, does not occur. 

The method of switching the angle after completing interleave unit presentation is described below. 
If the user selects second angle data MA2 during reproduction of interleave unit A51 in first angle data MAt, for 
20 example, the second interleave unit B52 in the second angle data MA2 is selected from the point reproduction of inter- 
leave unit A51 with a presentation time of i sec. is completed. Because the start of interleave unit B52 is 2 sec. from 
the beginning of the multi-angle scene period, there is a gap between the end of interleave unit A51 reproduction at 1 
sec. into the multi-angle scene period and the beginning of interleave unit B52 at 2 sec. into the multi-angle scene 
period, and there is therefore no time-base contiguity in reproduction. More specif really, because there is no continuity 
25 in the audio, the audio cannot be seamlessly reproduced. 

A similar scenario results il the user then switches to the angle scene corresponding to the third angle data MA3 
during reproduction of the second interleave unit B52 in the selected second angle data MA2. i.e., interleave unit C53 
is switched to after reproduction of inter leave unit B52 is completed. In this case the completion of interleave unit B52 
reproduction is at 5 sec. from the beginning of the multi-angle scene period, the beginning of interleave unit C53 is at 4 
so sec. from the beginning of the multi-angle scene period, and there is again no time-base contiguity. The connection 
between the audio and video components of the interleave units B52 and C53 is also not good. 

It is therefore necessary for the interleave units of each angle to have the same reproduction time and contain the 
same number of video frames in order to achieve seamless information switching between multiple angles. 

The internal structure of the interleave units is shown in further detail in Fig. 77. As shown in Fig. 77, each of the 
35 interleave units ILVUbi . ILVUb2. ILVUd . and !LVUc2 contains interleaved audio and video packets, indicated as A and 
V, respectively. 

In general, the data size and presentation time of each audio packet A is the same. In this example, interleave units 
ILVUbi , ILVUb2, ILVUci , and ILVUc2 respectively contain 3, 2, 2, and 3 audio packets. Therefore, angle data MAB and 
MAC each contain 5 audio packets and IS video packets in multi-angle scene period T2. 
ao Angle switching control within a multi-angle scene period comprising a multi-angle system stream (VOB) with this 

packet structure is described below. 

If the angle is switched from interleaved unit ILVUbi to interleaved unit lLVUc2, for example, the total number of 
audio packets in these two interleave units ILVUbi and ILVUc2 is 6, which is one more than the specified total number 
of 5 audio packets in this multi-angle scene period T2. This would therefore result in an overlap of one audio packet in 
45 the reproduced audio if these two ILVU were connected and reproduced Likewise, if the angle is changed between the 
two interleaved units ILVUci and ILVUb2 containing only two audio packets each, the total of 4 audio packets is one 
less than the specified total number of 5 audio packets in this multi-angle scene period T2. Connecting and reproducing 
these two interleaved units would therefore result in an audio packet shortage, and a break in the audio equal to the 
duration of one audio packet. It is therefore clear that when the number of audio packets in the connected interleaved 
50 units is not equal to the specified number of audio packets in that multi-angle scene period, the audio will not be satis- 
factorily connected, and non-seamless information presentation containing noise and/or intermittent audio will result. 

Fig. 45 shows multi-angle scene control when the multi-angle data MAB and MAC shown in Fig. 77 contain different 
audio data. Common angle data BAl and BA3 contain the common audio data of the common scenes before and after 
the multi-angle scene period. The first angle data MAB comprises first angle interleave unit audio data ILVUbi and 
55 ILVUb2, the smallest angle switching unit within the multi-angle scene period. The second angle data MAC likewise 
comprises second angle interleave unit audio data ILVUci and ILVUc2. 

Fig. 14 shows the audio waves resulting from the audio data recorded to the multi-angle data MAB and MAC within 
multi-angle scene period T2. The contiguous audic output of angle data MAE is formed from the. two interleaved unit 
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audio data ILVUbl and !LVUb2. The contiguous audio output o1 angle data MAC is likewise foimed fiom the two inter - 
leaved unit audio data ILVUcI and ILVUc2 

What happens when reproduction ol angle data MAC is switched to during reproduction ol the tiist interleave unit 
audio data ILVUbl in angle data MAB is descubed below. In this case repioduction of interleaved unit ILVUc2 occuis 
after reproduction ol interleaved unit ILVUbl is completed. As a lesult. the audio wave resulting iiom these two inter- 
leaves units is a mixed wave as shown by audio wave MAB-C in Fig. 12. Note that the resulting audio output wave is 
non-contiguous at the angle switching point, and the audio connection is therelore not completely satisfactory. 

11 the audio data is encoded using Dolby AC- 3 coding, the problems are even greater because AC-3 coding use 
time-base correlations. Specifically, because the audio is coded using time-base signal conelations. leproduction 
becomes impossible at the angle switching point when the user attempts to stop the audio data Irom one angle and 
switch to the audio data of another angle dunng reproduction in a multi-angle scene period. 

Thus, when each angle in a multi-angle scene period contains discrete audio data, the audio output may be inter- 
mitted between the connected data units when the angle is changed. Depending on the content of the data in such 
cases, noise and/or audio interruptions may occur duhng repioduction, resulting even in irritation or discomfort to the 
user. Such discomfort is a product of the non-contiguity in the reproduced information content, and can therefoie be 
avoided by assuring information contiguity or pi eventing information inter mittence. Seamless information presentation 
can thus be achieved. 

Multi-angle scene control according to the present invention is described next with reference to Fig. 46. Three angle 
data MA1 . MA2, and MAS are written to multi-angle scene period T2 in this example. 

The first angle data MAI thus contains angle switching units All. A12, and A13 as the smallest possible angle 
switching units. These angle switching units A51 . A52. and A53 have presentation times of 2, 1 , and 3 seconds, respec- 
tively. 

The second angle data MA2 similarly comprises angle switching units B11. B12, and B13. and the third angle data 
MA3 comprises angle switching units Cll. C12, and C13. Each of these angle switching units also respectively have 
presentation times of 2. 1 . and 3 seconds 

Because the synchronized interleave units thus have the same presentation times, contiguous audio and video 
reproduction can be achieved without interruptions or overlaps at the angle switching position even when the user 
switches from one angle to another angle, and seamless information presentation can therefore be achieved as previ- 
ously described. 

To achieve the data structure shown in Fig. 46, i.e., to set the actual presentation times of the smallest angle switch- 
ing units of the audio and video material in the multi-angle scene period to the same times, the number of reproduction 
frames in each interleave unit must be the same. MPEG data compression normally operates on the GOP unit level, 
and two parameters defining the GOP structure are the M and N values. M is the I- or P-picture cycle, and N is the 
number of frames contained in that GOP. Furthermore, changing the M or N parameter setting frequently during the 
encoding process simply complicates MPEG video encoding control, and is not, therefore, normally done. 

A method of achieving the data structure shown in Fig. 46, i.e., a method of setting the actual presentation times of 
the smallest angle switching units of the audio and video material in the multi-angle scene period to the same times, is 
described below with reference to Fig. 78. 

As the example shown in Fig. 78 writes two angle data units MAE and MAC to the multi-angle scene period, and 
each angle data unit comprises two interleaved units ILVUbl and ILVUb2, and ILVUcI and ILVUc2, respectively. This is 
for simplicity of discussion only. Each interleaved unit is a GOP structure. The GOP structures in the multi-angle scene 
period set the M and N parameters of the synchronized interleaved units ILVUbl and ILVUcI to the same values, and 
similarly set the M and N parameters of the synchronized interleaved units ILVUb2 and ILVUc2 to the same values. By 
thus using the same GOP structur e parameters in both angle data MAB and MAC, the presentation times ol the AV data 
in different angles can be set to the same on the smallest angle switching unit level. Thus, when the angle is changed 
from first angle data MAB ILVUb2 to angle data MAC ILVUc2, contiguous video presentation without video intermittence 
or overlap at the angle switching position can be achieved because the angle switching timing between these two ILVU 
is the same. 

A method for actually setting the audio data presentation times on the smallest angle switching unit level to the 
same value in different angles is described next with reference to Fig. 79. As in Fig. 77, the interleave units ILVUbl, 
ILVUb2, ILVUcI, and ILVUc2 contain interleaved audio and video packets, indicated as A and V, respectively. 

The audio packet A data size and presentation times are normally constant. As also shown in the figure. ILVUbl 
and ILVUcI in the multi-angle scene period have the same number of audio packets (2), and !LVUb2 and !LVUc2 have 
the same number of audio packets (3). By thus writing the same number of audio packets to the synchronized inter- 
leaved units ILVU of different angle data MAB and MAC. the audio data presentation times can be set the same on the 
smallest angle switching unit level in different angles. Thus, when the view is changed between angle data MAE and 
MAC, contiguous audio presentation without audio intermittence or overlap at the angle switching position can be 
achieved because the angle switching timing does not change. 
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However. H each oi the smallest angle switching units in the multi-angle scene period contain audio data describing 
discrete audio waves, it may not be possible (as clesci ibed above with leterence to Fig. 1 2) to achieve contiguous audio 
data reproduction at the angle switching point by simply coding each smallest angle switching unit (ILVU) with the same 
audio data presentation time. It is possible to avoid intermitting the audio presentation, however, by writing the same 
5 (common) audio data to each angle within a multi-angle scene period on the smallest angle switching unit (ILVU) level. 
As previously described, seamless information presentation can be achieved by arraying the data to assure contiguous 
information content before and alter the connection points in the reproduced data, or by tor matting the data in closed 
data units that are completely reproduced at the switching points. 

A further multi-angle scene period data structure in which common audio data is written to each different angle is 
w shown in Fig. 80. Unlike the structure shown in Fig. 45. this data structure is achieved by writing audio data that is com- 
plete within each switching unit (interleaved unit ILVU) to the angle data MAB and MAC. 

Because the audio data is thus complete within each inter leaved unit ILVU. audio data pi educing a discomforting 
audio wave as a result of connecting different audio waves at the angle switching point will not result even when the 
angle is changed by switching from first angle interleaved unit ILVUbl to second angle interleaved unit ILVUc2 within 
75 an encoded audio data multi-angle scene period thus structured. 

Note that if the audio data is formed with the same audio wave on the interleaved unit ILVU level, seamless infor- 
mation presentation can obviously be achieved just as when the audio wave data is complete within each interleaved 
unit ILVU. 

When the audio data is coded using Dolby AC-3 audio coding, the time-base correlations can be retained even 
20 when the angle is changed, and contiguous audio reproduction can be achieved at the angle switching point without 
noise or intermittence. because common audio data is written to the smallest angle switching units (ILVU) of the angle 
data or is complete within each interleaved unit ILVU. 

It should be noted that the present invention shall not be limited to only two or three types of angle data MA within 
the multi-angle scene period. The multi-angle scene period T2 shall also not be limited to VOB units, and may extend 
25 for the duration of the title stream. 

It is therefore possible to achieve seamless infor mation presentation as previously defined. 
The operation oi multi-angle control based on the digital video disk data structure is thus as described above. 
A method of recording to the recording medium multi-angle control data specifically enabling selection of a different 
angle data unit while reproducing one angle data unit in the same multi-angle scene period is. however, described 
30 below. 

The common angle data BA1 shown in Fig. 23 is arrayed to a contiguous block region, the interleave unit data of 
the multi-angle data MAI , MA2, and MA3 in the multi-angle scene period is arrayed to an interleaved block region, and 
the common angle data BA3 following thereafter is arrayed to the next contiguous block region. Referenced to the data 
structure shown in Fig. 16, the common angle data BA1 constitutes one cell, the multi-angle data MAI, MA2, and MA3 

35 each constitute one cell, the cells corresponding to the multi-angle data MA1 , MA2, and MA3 constitute one cell block 
(the cell block mode CBM of the MAI cell = "cell block start", the CBM oi the MA2 cell = "between first and last cells", 
and the CBM of the MA3 cell = "cell block end"), and these cell blocks are angle blocks (cell block type CBT = angle). 
The common angle data BA3 is the cell that connects to that angle block. The cell-cell connections are also set for 
seamless playback (seamless playback flag SPF = "seamless playback"). 

40 The structure of the stream containing a multi-angle scene period and the basics of the on-disk layout in the pre- 
ferred embodiment of the invention are shown in Fig. 47. The multi-angle scene period is a period in which the stream 
can be freely changed by the user. In a stream with the structure shown in Fig. 47, it is possible to switch to VOB-C or 
VOB-D during reproduction of VOB-B. It is therefore likewise possible to switch to VOB-B or VOB-D during reproduction 
of VOB-C, and to switch to VOB-C or VOB-B during reproduction of VOB-D. 

45 As previously described, the unit for changing the angle, i. e., the angle selection unit, is the smallest interleave unit 

obtained from the conditions defined by equations 3 and 4, and is defined as the angle interleave unit A-ILVU. A-ILVU 
management information is also added to the angle interleave unit A-ILVU. The navigation pack NV previously 
described corresponds to this A-ILVU management information. 

An example in which the last pack address in the current A-ILVU and the address of the next A-ILVU are recorded 

50 for plural angles is shown as another embodiment of the invention in Fig. 48. While this figure is very similar to Fig. 42. 
the angle interleave unit A-ILVU comprises two video object units VOBU in this example, and the navigation pack NV of 
each VOBU contains the ILVU end pack address ILVU_EA indicating the address of the last pack in the ILVU to which 
the VOBU belongs, and the next-ILVU start address for each angle data block *n - #9 (SML_AGL_Cl_DSTA - 
SML_AGL_C9_DSTA). These addresses are expressed as the number of sectors from the navigation pack NV contain- 

55 ing the address information. In fields in which there is no angle data, information indicating that there is no angle data, 
e.g., 0, is recorded. By thus recording the last pack address and the next-ILVU start address tor each angle data block 
#1 - #9, it is possible to know the address of each next selectable angle and to switch to a different angle scene without 
reading unnecessary angle information. 
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Foi interleaving data in the multi-angle scene penod. ail angles aie interleaved to the same time reference (inter- 
leave boundary) using the angle intei leave unit A-ILVU toi the shortest read time This is to enable the angle to be 
changed as quickly as possible within the pertoimance limits o1 the DVD playei Interleave unit data is temporarily 
stored to the tiack btitlei, and the data loi the angle selected next is then input to the track butler. However, the next 
angle cannot be lepioduced until the data loi the pievious angle (the angle being lepioduced when the angle was 
changed) in the track butter has been consumed. It is theielore necessaiy to minimize the size ol the angle interleave 
unit A-ILVU in ordei to maximize the speed at which the next angle scene can be selected and presented. A common 
interleave unit size and boundary position must theietoie be used between the VOB constituting each angle. 

This means that the reproduction time of the encoded video stream forming the VOB must be the same for each 
VOB. and the time at which each interleave unit can be reproduced must be the same, i.e., the interleave unit bounda- 
ries must be common, toi each interleave unit at the same reproduction time in each angle. More specifically, the VOBs 
constituting each angle must be divided into the same number of interleave units, and the reproduction time of said 
interleave units must be the same in each angle, i.e.. the VOBs constituting each angle must be divided into the same 
numbei N of intei leave units, and the k-th intei leave unit (where 1 < k < N) in each angle must have the same reproduc- 
tion time. 

Moieovei . to seamlessly lepioduce the intei leave units between each angle, the encoded stream must be com- 
plete within each interleave units. This means that under the MPEG standard, a closed GOP structure using a compres- 
sion method that does not reference any frames outside the interleave unit must be used. If this method is not used, it 
is not possible to seamless connect and reproduce interleave units from different angles. By using this VOB structure 
and interleave unit alignment, however, contiguous leproduction is possible time-wise even if the angle is changed. 

The number of interleave units in the multi-angle scene period is determined by the number of interleave units in 
the other angles that can be arrayed within the jumpable distance after an interleave unit is read. Regarding the 
arrangement of the interleaved units in each angle, the interleave units reproduced first in each angle are arrayed in the 
angle sequence, and are subsequently followed by the interleave units reproduced next in each angle being arrayed in 
the angle sequence. Thus, if the numbei of angles is M (where M is a natural number, and 1 < M < 9). the m-th angle is 
angle #m (where m is a natural number, and 1 < m < M). the number of interleave units is N (where N is a natural 
number greater than or equal to 1). and the n-th interleave unit in a VOB is interleave unit #n (where n is a natural 
number, and 1 < n < N). the interleave unit sequence is angle #1 interleave unit #1, angle #2 interleave unit #1. angle 
#3 interleave unit #1 . . . . angle #M interleave unit #1 . angle #1 interleave unit #2, angle #2 interleave unit #2, . . . 

If the interleave unit length of each angle is the shortest read time for seamlessly selected angles where the angle 
change is seamless, the maximum distance that must be jumped when moving between angles is the distance from the 
first angle interleave unit in the sequence to the last interleave unit in the interleave unit sequence of the next angle 
reproduced within the sequence of angle interleave units reproduced at the same time. Thus, if the number of angles is 
An, the jump distance must satisfy the following equation 7. 

max. angle ILVU length x (An - 1) x 2 < jumpable distance [7] 

With non-seamless multi-angle switching, each angle must be seamlessly reproduced, but seamless reproduction 
is not required when moving between angles. Therefore, if the interleave unit length of each angle is the shortest read 
time, the maximum distance that must be jumped when moving between angles is the distance between the interleave 
units of each angle. Thus, if the number of angles is An. the jump distance must satisfy the following equation 8. 

max. angle ILVU length x (An - 1) < jumpable distance [8] 

The method of managing addresses on the switching unit level between multiple angle data VOB in multi-angle 
scene periods is described below with reference to Figs. 49 and 50. In Fig. 49 the angle interleave unit A-ILVU is the 
data switching unit, and the address of another angle interleave unit A-ILVU is written to the navigation pack NVof each 
angle interleave unit A-ILVU. Fig. 49 shows the address description achieving seamless reproduction, i.e., uninter- 
rupted reproduction of the audio and video data. This addressing method specifically provides for control whereby only 
the data for the interleave units of the angle to be reproduced is read into the track buffer when the angle is changed. 

Fig. 50 shows an example in which the video object unit VOBU is the data switching unit, and the address of 
another video object unit VOBU is written to the navigation pack NV of each video object unit VOBU. This addressing 
method provides for non-seamless reproduction control whereby reproduction can be changed as quickly as possible 
to another angle near the time when the angle is changed. 

In Fig. 49. each angle interleave unit A-ILVU in the three multi-angle data VOB-B, VOB-C. and VOB-D records as 
the address of the next angle interleave unit A-ILVU to be reproduced the address of a chronologically later A-ILVU. 
Note that VOB-B is designated angle #1, VOB-C is angle #2, and VOB-D is angle #£. The multi-angle data VOB-B con- 
sists of angle interleave units A-ILVUbl, A-ILVUb2. and A-ILVUbS. multi-angle data VOB-C similarly consists of angle 
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interleave units A-ILVUci . A-ILVUc2. and A-ILVUcS. and multi-angle data VOB-D o1 angle interleave units A-ILVUdl , A- 
ILVUd2. and A-ILVUd3. 

The navigation pack NV ol angle interleave unit A-ILVUbl contains SML_AGL_C#1_DSTA pointing to the relative 
addiess ot the next angle interleave unit A-ILVUb2 in VOB-B. as shown by line Pblb: SML_AGL_C#2_DSTA pointing 
i to the relative addiess ol VOB-C angle interleave unit A-ILVUc2 synchionired to the same (next) angle interleave unit 
A-ILVUb2 as shown by line Pbic; and SML_AGL_C#3_DSTA pointing to the relative addiess o1 the VOB-D angle inter- 
leave unit A-ILVUd2 as shown by line Pbid. 

As shown by lines Pb2b. Pb2c. and Pb2d, the navigation pack NV of the next angle interleave unit A-ILVUb2 in the 
same video object VOB-B likewise contains SML_AGL_C£1_DSTA. SML_AGL_C#2_DSTA. and 
w SML_AGL_C#3_DSTA pointing to the relative address ol the next angle inlerleave units A-ILVUb3. A-ILVUC3. and A- 
!LVUd3 in VOB-B. VOB-C. and VOB-D. respectively. 

Note that the relative addresses aie all expressed as the number ol sectors trom the navigation pack NV ot the 
VOBU contained in each interleave unit. 

Addresses are similarly wiitlen to the navigation pack NV ol the tiist angle interleave unit A-ILVUc1 in VOB-C, i.e.. 
75 SML_AGL_C#2_DSTA pointing to the relative addiess ol the next angle interleave unit A-ILVUc2 in VOB-C as shown 
by line Pclc; SML_AGL_C#1_DSTA pointing to the relative addiess ol the same (next) angle interleave unit A-ILVUb2 
in VOB-B. as shown by line Pclb; and SML_AGL_C#3_DSTA pointing to the relative addiess ot the VOB-D angle inter- 
leave unit A-ILVUd2 as shown by line Pcld. 

As shown by lines Pc2c. Pc2b. and Pc2d. the navigation pack NV of the next angle interleave unit A-ILVUc2 in VOB- 
20 C likewise contains the relative addresses SML_AGL_C#2_DSTA, SML_AGL_C#1_DSTA, and SML_AGL_C#3_DSTA 
pointing to the next angle interleave units A-ILVUc3, A-ILVUb3. and A-ILVUd3 in the respective video objects VOB. 

Again note that the relative addresses are all expressed as the number ot sectors Irom the navigation pack NV of 
the VOBU contained in each interleave unit. 

Addresses are similarly written to the navigation pack NV ol the first angle interleave unit A-ILVUdl in VOB-D. i.e.. 
25 SML_AGL_C#3_DSTA pointing to the relative address of the next angle interleave unit A-ILVUd2 in VOB-D as shown 
by line Pdld; SML_AGL_C#1_DSTA pointing to the relative address of the same (next) angle interleave unit A-ILVUb2 
in VOB-B. as shown by line Pdib; and SML_AGL_C#2_DSTA pointing to the relative address of VOB-C angle interleave 
unit A-ILVUC2 as shown by line Pdic. 

As shown by lines Pd2d, Pd2b, and Pd2c. the navigation pack NV of the next angle interleave unit A-ILVUd2 in 
so VOB-D likewise contains the relative addresses SML_AGL_C#3_DSTA. SML_AGL_C#1_DSTA, and 
SML_AGL_C#2_DSTA pointing to the next angle interleave units A-ILVUd3. A-ILVUb3. and A-ILVUc3 in the respective 
video objects VOB. 

Again note that the relative addresses are all expressed as the number of sectors from the navigation pack NV of 
the VOBU contained in each interleave unit. 
25 In addition to the addresses SML_AGL_C#1_DSTA - SML_AGL_C#S_DSTA, each navigation pack NV also con- 

tains various parameter data as previously described with respect to Fig. 20, and further description thereof is thus 
omitted lor simplicity. 

This address information more specifically includes in the navigation pack NV ol angle interleave unit A-ILVUb1 , for 
example, the end address ILVU_EA ot the angle interleave unit A-ILVUbi to which the navigation pack NV belongs, and 
ao the addresses SML_AGL_C£1_DSTA, SML_AGL_C#2_DSTA, and SML_AGL_C#3_DSTA of the navigation packs NV 
of the next angle interleave units A-ILVUb2, A-ILVUc2. A-ILVUd2 that can be reproduced. The navigation pack NV of A- 
ILVUb2 contains the end address ILVU_EA of A-ILVUb2. and the addresses SML_AGL_C#1_DSTA, 
SML_AGL_C#2_DSTA, and SML_AGL_C#S_DSTA of the navigation packs NV of the next angle interleave units A- 
ILVUb3, A-ILVUc3. A-ILVUd3 reproduced. The navigation pack NV of A-ILVUb3. the last interleave unit in the sequence 
45 in this example, contains the end address ILVU_EA of A-ILVUb3, and termination information as the address of the nav- 
igation pack NV of the next A-ILVU reproduced, e.g.. a NULL value or string of all Is as the ILVU_EA. 

The specifics of the address information written to the other video objects VOB-C and VOB-D in this example are 
the same. 

By writing this address information to the navigation packs NV of each angle interleave unit A-ILVU, it is possible to 
50 read ahead the address of the next A-ILVU to be reproduced in chronological sequence, and is therefore suited to 
seamless reproduction. Furthermore, because the address of the next A-ILVU in each of the other available angles is 
also recorded to each navigation pack TsJV. the next address of the selected angle can be easily obtained without giving 
special consideration to whether the angle is changed or not, and jumping to the next interleave unit can be controlled 
by the same control sequence. 

55 By thus recording the relative addresses of each A-ILVU that can be selected from each angle, and constructing 
the encoded video stream contained in each A-ILVU from closed GOP, seamless reproduction without video disruption 
can be achieved when the viewing angle is changed. 

The audio data can also be seamlessly reproduced if the same audio is recorded 1or each angle, rf the audio is 
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complete within each ILVU. or H discrete audio data is. recorded Moreover, H identical audio data is recorded to each 
interleaved unit ILVU. the listener will not even be ab!e to discern that the audio track has changed H the audio is seam- 
lessly reproduced across angle changes 

A data structure enabling non-seamless reproduction ot angle changes, i.e.. seamless data reproduction permitting 
perceptible breaks in the content ot the reproduced rntor matron, is described below with releience to Fig. 50. 

It is assumed in Fig. 50 that multi-angle data VOB-B comprises three video object units VOBUbl. VOBUb2. and 
VOBUb3. Multi-angle data VOB-C similarly comprises three video object units VOBUcl. VOBUc2, and VOBUc3. and 
VOB-D comprises three video object units VOBUdl . VOBUd2. and VOBUd3. As in the case shown in Fig. 49. the nav- 
igation pack NV of each video object unit VOBU contains the end pack address VOBU_EA ot each VOBU Note that 
this end pack address VOBU_EA is the address of a navigation pack NV in a VOBU comprising a navigation pack NV 
and one or more other packs. In this example, however, the NSML_AGL_C*_DSTA address written to the navigation 
pack NV of each VOBU does not describe a chronologically later VOBU address, but the address ot a VOBU in a differ - 
ent angle with a reproduction time preceding the time the angle is changed. 

In other words, addresses NSML_AGL_C#1_DSTA to NSML_ AGL_C#9_DSTA to VOBU in other angles synchro- 
nized to the current VOBU aie recorded. As above. #1 - #9 represent different angle numbers For fields in which an 
angle of the corresponding number does not exist, a value, e.g., 0, indicating that the angle does not exist is recorded. 
Thus, the navigation pack NV of video object unit VOBUbl of multi-angle data VOB-B contains NSML_AGL_C#2_DSTA 
and NSML_AGL_C#3_DSTA, the relative addresses of the synchronized VOBUcl and VOBUdl in VOB-C and VOB-D 
as shown by lines Pbl c' and Pbl d*. 

The navigation pack NV of video object unit VOBUb2 similarly contains as shown by lines Pb2c* and Pb2d* the rel- 
ative addresses NSML_AGL_C#2_DSTA and NSML_AGL_C#3_DSTAof the synchronized VOBUc2 and VOBUd2. The 
navigation pack NV of video object unit VOBUb3 similarly contains as shown by lines Pb3c' and Pb3d' the relative 
addresses N SM L_ AG L_C#2_ D STA and NSML_AGL_C#3_DSTA of the synchronized VOBUc3 and VOBUd3. 

The navigation packs NV of video object units VOBUcl . VOBUc2. and VOBUc3 of VOB-C similarly contain the rel- 
ative addresses N SM L_ AG L_C# 1 _DSTA and NSML_AGL_C#3_DSTA of the respectively synchronized VOBU as 
shown by lines Pclb'. Pcld'. Pc2b*. Pc2d\ Pc3b\ and Pc3d\ 

The navigation packs NV of video object units VOBUdl . VOBUd2. and VOBUd3 of VOB-D likewise contain the rel- 
ative addresses N SM L_ AG L_C# 1 _ D STA and N SM L_ AG L_C#2_ D STA of the respectively synchronized VOBU as 
shown by lines Pdlb'. Pdlc*. Pd2b\ Pd2c\ Pd3b\ and Pd3c\ 

The angle selection address information NSML_AGL_C#4_DSTA to N SM L_ AG L_C#9_D STA for non-existent 
angles #4 - #9 in this example record a value indicating that corresponding angles do not exist, e.g., a 0 value. 

During reproduction of angle data with this data structure, the DVD decoder interrupts reproduction of the angle 
VOBU data currently being reproduced when the angle is changed, then reads and begins reproducing the VOBU data 
for the selected angle. 

Note that while there appears to be a time offset between the interleaved units of VOB-C relative to VOB-B and 
VOB-D in Fig. 50, this is merely to facilitate easier understanding of the address descriptions written to the respective 
navigation packs NV of each VOB using the line arrows as shown. There is, in fact, no time shifting between the respec- 
tive interleaved video objects VOB, which are aligned as shown in Fig. 49. 

The data structure shown in Fig. 50 thus contains as pointers to the next VOBU to be reproduced addresses to 
another VOBU that should normally be reproduced either simultaneously with or chronologically before the VOBU con- 
taining the address information. Therefore, when the angle is changed, reproduction is continued from a scene at a past 
point in time. This method of encoding the address information is thus preferable when seamless angle switching not 
required, i.e., for non-seamless information reproduction in which contiguity is not required in the reproduced informa- 
tion. 

Flow chart: encoder 

The encoding information table generated by the encoding system controller 200 from information extracted from 
the scenario data St7 is described below referring to Fig. 27. 

The encoding information table contains VOB set data streams containing plural VOB corresponding to the scene 
periods beginning and ending at the scene branching and connecting points, and VOB data streams corresponding to 
each scene. These VOB set data streams shown in Fig. 27 are the encoding information tables generated at step #100 
in Fig. 51 by the encoding system controller 200 for creating the DVD multimedia stream based on the user-defined title 
content. 

The user-defined scenario contains branching points from common scenes to- plural scenes, or connection points 
to other common scenes. The VOB corresponding to the scene period delimited by these branching and connecting 
points is a VOB set, and the data generated to encode a VOB set is the VOB set data stream. The title number specified 
by the VOB set data stream is the title number TiTLE_NO of the VOB set data stream. 
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The VOB Set data structure in Fig. 21 shew?, the data content toi encoding one VOB set in the VOB set data 
stream, and comprises: the VOB set numbei VOBS_NO. the VOB numbei VOB_NO in the VOB set. the preceding VOB 
seamless connection flag VOB_Fsb. the following VOB seamless connection flag VOB_Fsf. the multi-scene flag 
VOB_Fp. the interleave flag VOB_Fi. the multi-angle flag VOB_Fm, the multi-angle seamless switching flag VOB^FsV. 
the maximum bit rate of the interleaved VOB ILV BR. the number of interleaved VOB divisions ILVDIV, and the mini- 
mum interleaved unit presentation time ILVU_M1. 

The VOB set number VOBS_NO is a sequential- number identifying the VOB set and the position of the VOB set in 
the reproduction sequence of the title scenario. 

The VOB numbei VOB_NO is a sequential number identifying the VOB and the position of the VOB in the repro- 
duction secuence of the title scenario. 

The preceding VOB seamless connection flag VOB_Fsb indicates whether a seamless connection with the preced- 
ing VOB is recused tor scenario repioduction. 

The touching. VOB seamless connection flag VOB_Fst indicates whether there is a seamless connection with the 
following VOB during scenario reproduction. 

The muti»-*>ce«H? flag VOE_Fp identifies whethei the VOB set comprises plural video objects VOB. 

The mteiivrfve hag V06_Fi identifies whethei the VOB in the VOB set aie interleaved. 

The muhi-angi* twig VOB Tm identifies whethei the VOB set is a multi-angle set. 

The muhi-engi* wam*ess switching flag VOB_FsV identifies whether angle changes within the multi-angle scene 
period are seamier o not 

The ma>in\jm t»t »atc o* trv* me« leaved VOB ILV_BR defines the maximum bit rate of the interleaved VOBs. 

The numbet o* *y*m-+***m'j wOB av^ons ILV_DIV identifies the number of interleave units in the interleaved VOB. 

The minimum irr*» ^r* pr ^e^oa^on time ILVU_MT defines the time that can be reproduced when the bit rate 
of the smallest int** r>« a? •^•cr* a t>ac* butlei data underflow state does not occur is the maximum bit rate of the 

interleaved VOB It V F*- -1 # i^^i r>ock reproduction. 

The encoding m*.-. ~v»%r»~ i*** %-> **ch VOB generated by the encoding system controller 200 based on the sce- 
nario data St7 is d€wc^: t*-to» -H^rmr to Fig. 28. The VOB encoding parameters described below and supplied to 
the video encode* 30C a.**c +rvjxn* 70C and system encoder 900 for stream encoding are produced based on this 
encoding information tar** 

The VOB data stie*^ vnc*m .n Fig 28 are the encoding information tables generated at step #100 in Fig. 51 by 
the encoding system cc***:**« ?X) x* creating the DVD multimedia stream based on the user-defined title content. 

The encoding unit c tr*- **aeo object VOB, and the data generated to encode each video object VOB is the VOB 
data stream For e»a-nx- a »OE tet comprising three angle scenes comprises three video objects VOB. The data 
structure shown m F«g ?£ -a.w, the content of the data for encoding one VOB in the VOB data stream. 

The VOB data snuct^* corrtams the video material start time VOB_VST, the video material end time VOB_VEND, 
the video signal type VOE V kind, the video encoding bit rate V_BR, the audio material start time VOB_AST, the 
audio material end time VC-6 aend. the audio coding method VOB_A_KIND, and the audio encoding bit rate A_BR. 

The video material sta-t t>me VOB_VST is the video encoding start time corresponding to the time of the video sig- 
nal. 

The vioeo material enc line V03_VEND is the video encoding end time corresponding to the time of the video sig- 
nal 

The video materia' type vOB_V_K1ND identifies whether the encoded material is in the NTSC or PAL format, for 
example, or is photogrr**^ mate* tal (a movie, for example) converted to a television broadcast format (so-called tele- 
cine conveiston) 

The video encco«x; l*- »a!e v BR is the bit rate at which the video signal is encoded. 

The audio matenai sta t t»-^ VOG_ AST is the audio encoding start time corresponding to the time of the audio sig- 
nal. 

The audio material end tv^c V03_ AEND is the audio encoding end time corresponding to the time of the audio sig- 
nal. 

The audio coding metnoct vOB_A_KIND identifies the audio encoding method as AC-3, MPEG, or linear PCM, for 
example. 

The audio encoding c*t rate A_BR is the bit rate at which the audio signal is encoded. 

The encoding param<*<*o» used by the video encoder 300. sub-picture encoder 500, and audio encoder 700, and 
system encoder 900 fc* VOF encoding are shown in Fig. 29. The encoding parameters include: the VOB number 
VOB_NO. video encode start time V_STTM, video encode end time V_ENDTM, the video encode mode V_ENCMD, 
the video encode bit rate V RATE, the maximum video encode bit rate V_MRATE. the GOP structure fixing flag 
GOP_Fxflag, the video encoce GOP structure GOPST, the initial video encode data VJNTST, the last video encode 
data V_ENDST, the auo»o encode start time A_STTM, the audio encode end time A_ENDTM, the audio encode bit rate 
A_RATE, the audio encode method A_ENCMD, the audio start gap A_STGAP, the audio end gap A_ENDGAP, the pre- 
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ceding VOB numbei B_ VOB_ NO. and the following VOB number F_VOK N( > 

The VOB numbei VOE_NO is a sequential numbei identilying the VOL and the position oi the VOB in the repro- 
duction sequence o1 the title scenano 

The video encode start time V_ STTM is the start time of video matenal encoding 

The video encode end time V_ENDTM is the end time oi video matenal encoding 

The video encode mode VENCMD is an encoding mode lor declanny whethei leveise telecine conversion shall 
be accomplished during video encoding to enable efficient coding when the video material is telecine converted mate- 
rial. 

The video encode bit rate VRATE is the average bit rate oi video encoding. 

The maximum video encode bit rate VMRATE is the maximum bit rate of video encoding. 

The GOP structure lixing tlag GOP_Fx1lag specifies whethei encoding is accomplished without changing the GOP 
structure in the middle of the video encoding process. This is a useful paiametei tor declaring whether seamless switch 
is enabled in a multi-angle scene peiiod. 

The video encode GOP slruduie GOPST is the GOP structure data Irom encoding. 

The initial video encode data VJNTST sets the initial value of the VBV buffer (decodei bulfer) at the start of video 
encoding, and is i elei enced dui ing video decoding to initialize the decoding buffei . This is a useful parameter for declar- 
ing seamless reproduction with the preceding encoded video stream. 

The last video encode data V_ENDST sets the end value oi the VBV buffer (decoder buffer) at the end of video 
encoding, and is referenced during video decoding to initialize the decoding buffei. This is a useful parameter for declar- 
ing seamless reproduction with the preceding encoded video stream. 

The audio encode start time A_STTM is the start time of audio material encoding. 

The audio encode end time A_ENDTM is the end time of audio material encoding. 

The audio encode bit rate A_RATE is the bit rate used for audio encoding. 

The audio encode method A_ENJCMD identities the audio encoding method as AC-3. MPEG, or linear PCM, for 
example 

The audio start gap A_STGAP is the time offset between the start of the audio and video presentation at the begin- 
ning of a VOB. This is a useful parameter for declaring seamless reproduction with the preceding encoded system 
stream. 

The audio end gap A_ENDGAP is the time offset between the end of the audio and video presentation at the end 
of a VOB. This is a useful parameter for declaring seamless reproduction with the preceding encoded system stream. 

The preceding VOB number B_VOB_NO is the VOB_NO of the preceding VOB when there is a seamlessly con- 
nected preceding VOB. 

The following VOB number F_VOB_NO is the VOB_NO of the following VOB when there is a seamlessly connected 
following VOB. 

The operation of a DVD encoder ECD according to the present invention is described below with reference to the 
flow chart in Fig. 51 . Note that the steps shown with a double line are subroutines. It should be obvious that while the 
operation described below relates specifically in this case to the DVD encoder ECD of the present invention, the oper- 
ation described also applies to an authoring encoder EC. 

At step #100, the user inputs the editing commands according to the user-defined scenario while confirming the 
content of the multimedia source data streams Sn, St2, and St3. 

At step #200, the scenario editor 1 00 generates the scenario data St7 containing the above edit command informa- 
tion according to the user's editing instructions. 

When generating the scenario data St7 in step #200, the user editing commands related to multi-angle and paren- 
tal lock multi-scene periods in which interleaving is presumed must be input to satisfy the following conditions. 

First, the VOB maximum bit rate must be set to assure sufficient image quality, and the track buff er capacity, jump 
performance, jump time, and jump distance of the DVD decoder DCD used as the reproduction apparatus of the DVD 
encoded data must be determined. Based on these values, the reproduction time of the shortest interleaved unit is 
obtained from equations 3 and 4. Based on the reproduction time of each scene in the multi-scene period, it must then 
be determined whether equations 5 and 6 are satisfied. If equations 5 and 6 are not satisfied, the user must change the 
edit commands until equations 5 and 6 are satisfied by, for example, connecting part of the following scene to each 
scene in the multi-scene period. 

When multi-angle edit commands are used, eauation 7 must be satisfied for seamless switching, and edit com- 
mands matching the audio reproduction time with the reproduction time oi each scene in each angle must be entered. 
If non-seamless switching is used, the use must enter commands to satisfy equation 8. 

At step #300, the encoding system controllei 200 first determines whether the target scene is to be seamlessly con- 
nected to the preceding scene based on the scenario data St7. 

Note that when the preceding scene period is a multi-scene period comprising plural scenes but the presently 
selected target scene is a common scene (not in a multi-scene period), a seamless connection refers to seamlessly 
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* * connecting the target scene with any one ot the scenes contained in the preceding multi-scene period. When the target 

scene is a multi-scene peiiod. a seamless connection still refers to seamlessly connecting the target scene with any 

one of the scenes tiom the same multi-scene peiiod. 

If step #300 returns NO. i.e.. a non-seamless connection is valid, the procedure moves to step #400. 
i At step #400. the encoding system controller 200 resets the preceding VOB seamless connection flag VOB_Fsb 

indicating whether theie is a seamless connection between the target and preceding scenes. The procedure then 

moves to step #600. 

On the other hand, if step #300 returns YES. i.e.. theie is a seamless connection to the preceding scene, the pro- 
cedure moves to step #500. 

w At step #500 the encoding system controller 200 sets the preceding VOB seamless connection flag VOB_Fsb. The 

procedure then moves to step #600. 

At step #600 the encoding system conti oiler 200 determines whether there is a seamless connection between the 
target and following scenes based on scenario data St7. If step #600 returns NO. i.e.. a non-seamless connection is 
valid, the procedui e moves to step #700. 
J5 At step #700. the encoding system controller 200 i esets the following VOB seamless connection flag VOB_Fsf indi- 

cating whethei theie is a seamless connection with the following scene. The piocedure then moves to step #900. 

However, if step #600 returns YES. i.e.. there is a seamless connection to the following scene, the procedure 
moves to step #800. 

At step #800 the encoding system controller 200 sets the following VOB seamless connection flag VOB_Fsf. The 
20 procedure then moves to step #900. 

At step #900 the encoding system controller 200 determines whether ther e is more than connection target scene, 
i.e.. whether a mufti-scene period is selected, based on the scenario data St7. As previously described, there are two 
possible control methods in multi-scene periods: parental lock control whereby only one of plural possible reproduction 
paths that can be constructed from the scenes in the multi-scene period is reproduced, and multi-angle control whereby 
25 the reproduction path can be switched within the multi-scene period to present different viewing angles. 
If step #900 returns NO. i.e.. there are not multiple scenes, the procedure moves to step #1000. 
At step #1000 the multi-scene flag VOB_Fp identifying whether the VOB set comprises plural video objects VOB (a 
multi-scene period is selected) is reset, and the procedure moves to step #1800 for encode parameter production. This 
encode parameter production subroutine is described below. 
so However, if step #900 returns YES. there is a multi-scene connection, the procedure moves to step #1 100. 

At step #1 100. the multi-scene flag VOB_Fp is set. and the piocedure moves to step #1200 whereat it is judged 
whether a multi-angle connection is selected, or not. 

At step #1200 it is determined whether a change is made between plural scenes in the multi-scene period, i.e.. 
whether a multi-angle scene period is selected. If step #1200 returns NO, i.e., no scene change is allowed in the multi- 
35 scene period as parental lock control reproducing only one reproduction path has been selected, the procedure moves 
to step #1300. 

At step #1300 the multi-angle flag VOB_Fm identifying whethei the target connection scene is a multi-angle scene 
is reset, and the procedure moves to step #1302. 

At step #1302 it is determined whether either the preceding VOB seamless connection flag VOB_Fsb or following 
40 VOB seamless connection flag VOB_Fsf is set. If step #1302 returns YES, i.e.. the target connection scene seamlessly 
connects to the preceding, the following, or both the preceding and following scenes, the procedure moves to step 
#1304. 

At step #1304 the interleave flag VOB_Fi identifying whether the VOB, the encoded data of the target scene, is 
interleaved is set. The piocedure then moves to step #1800. 
45 However, if step #1302 returns NO, i.e., the target connection scene does not seamlessly connect to the preceding 

or following scene, the procedure moves to step #1306. 

At step #1306 the interleave flag VOB_Fi is reset, and the procedure moves to step #1800. 
If step #1200 returns YES. however, i. e., there is a multi-angle connection, the procedure moves to step #1400. 
At step #1400, the multi-angle flag VOB_Fm and interleave flag VOE_Fi are set. and the procedure moves to step 
so #1500. 

At step #1500 the encoding system controller 200 determines whether the audio and video can be seamlessly 
switched in a multi-angle scene period, i.e.. at a reproduction unit smaller than the VOB, based on the scenario data 
St7. If step #1500 returns NO, i.e., non-seamless switching occurs, the procedure moves to step #1600. 

At step #1600 the multi-angle seamless switching flag VOB_FsV indicating whether angle changes within the multi- 
55 angle scene period are seamless or not is reset, and the procedure moves to step #1800. 

However, if step #1500 returns YES. i.e., seamless switching occurs, the procedure moves to step #1700. 

At step #1700 the multi-angle seamless switching flag VOE_FsV is set, and the procedure moves to step #1800. 

Therefore, as shown by the flow chart in Fig. 51 , encode parameter production (step #1800) is only begun after the 



41 



EP0 847 198 A1 



editing information is detected 1iom the abovt 1lau i ettmui. in the scenario data St7 leliecting the usei -defined editing 
instruct tons 

Based on the usei-detmed editing mstiuctiorc. detected fiom the above t lag settings in the scenaiiodata St7. infoi- 
mation is added to the encoding inloimalion tables 1oi the VOB Set units and VOB units as shown in Figs. 27 and 28 to 
encode the source sti earns, and the encoding paiameteis ot the VOB data units shown in Fig. 29 are produced, in step 
#1600 The pioceduie then moves to step # 1900 1oi audio and video encoding. 

The encode parameter production steps (step #1800) aie described in greater detail below reierring to Figs. 52, 53. 
54. and 55 

Based on the encode parameters pioduced in step #1800. the video data and audio data are encoded in step 
#1900. and the procedure moves to step #2000. 

Note that tne sub-picture data is normally inserted during video reproduction on an as-needed basis, and contiguity 
with tne preceding and following scenes istherelore not usually necessary. Moreover, the sub-picture data is normally 
voeo information to one frame, and unlike audio and video data having an extended time-base, sub-picture data is 
usually static, and ib not noimally piesenied continuously. Because the present invention relates specifically to seam- 
less and non-seamJ«^ contiguous reproduction as desciibed above, description ot sub-pictuie data encoding is omit- 
ted heiem toi sunplic-ty 

Step #2000 a tne last Mep «n a loop compnsing steps #300 to step #2000, and causes this loop to be repeated as 
many times as tne»e are vOG Oets This-loop formats the program chain VTS_PGC#i to contain the reproduction 
sequence and otne» » cc* odoc*jon information foi each VOB in the title (Fig. 16) in the program chain data structure, 
interleaves the VOB r> tr>o f^jn* vconopofiodc. and completes the VOB Set data stream and VOB data stream needed 
for system stream encoding Tr-ve p» ocedcue then moves to step #2100. 

At step <r2 10C tn* vl<: \.*t cuu tt» wn completed as the encoding information table by adding the total number 
of VOB Sets VOBS_ NUM crjo-n*ri as • »ewf of the loop through step #2000 to the VOB Set data stream, and setting 
the number of trtles TIT l f rutmr; rr*> mimner of scenario reproduction paths in the scenario data St7. The pro- 
cedure then moves to 

System stream encorto; ^coxirx; r»e VOB (VOB#i) data in the VTS title VOBS (VTSTT_VOBS) <Fig. 16) is 
accomplished m stec *r?o: t*iv«i on r>* encoded video stream and encoded audio stream output from step #1900. 
and the encode par a mere** r * *^ ;*> 'he procedure then moves to step #2300. 

At step #2300 the vTi. rt^rrva:«n VTSI. VTSI management table VTSI_MAT, VTSPGC information table 
VTS_PGCIT. and the p» og»*^ c-*v*m mioi mation VTS_PGCI#i controlling the VOB data reproduction sequence shown 
in Fig 16 are produced anc io»rnatt>ng tc. tor example, interleave the VOB contained in the multi-scene periods, is 
accomplished The soecrf< s:«-c*> executed in this lormatting operation are described below with reference to Figs. 56, 
57. 58. 59. and 60 

The encode parameter poduaon subroutine shown as step #1800 in Fig. 51 B is described next using Figs. 52, 
53. and 54 using by way o* e»arnp*e the operation generating the encode parameters for multi-angle control. 

Starting from Fig 52 tne access tor generating the encode parameters of a non-seamless switching stream with 
multi-angle control is desotx?o first This stream is generated when step #1500 in Fig. 51 returns NO and the following 
flags are set as shown VOB * so - *. or VOB_Fst = 1 , VOB_Fp = 1 , VOB_Fi = 1 , VOB_Fm = 1 , and VOB_FsV = 0. The 
following operation produces tr»e encoding information tables shown in Fig. 27 and Fig. 28, and the encode parameters 
shown in Fig. 29 

At step #1812. the scenaro reproduction sequence (path) contained in the scenario data St7 is extracted, the VOB 
Set number VOBS_NO * and tne VOB number VOB_NO is set for one or more VOB in the VOB Set. 

At step #1814 the n*nriv*"L>.t iate ILVJ3R of the interleaved VOB is extracted from the scenario data St7, and the 
maximum video encode t>\ «a!r v MR ATE from the encode parameters is set based on the interleave flag VOB_Fi set- 
ting (= 1). 

At step #1816. the rT*n.rrvm *Tie* leaved unit presentation time ILVU_MT is extracted from the scenario data St7. 

At step #1816. the voce encode GOP structure GOPST values N = 15 and M = 3 are set, and the GOP structure 
fixing flag GOP_Fxflag tc set <- t ; based on the multi-scene flag VOB_Fp setting (= 1). 

Step #1820 is the common VOB data setting routine, which is described below referring to the flow chart in Fig. 53. 
This common VOB oats setting routine produces the encoding information tables shown in Figs. 27 and 28, and the 
encode parameters shown m F ig ?c 

At step #1822 the video rrwi*n*i start time VOB_VST and video material end time VOB_VEND are extracted for 
each VOB, and the video eocene start time V_STTM and video encode end time V_ENDTM are used as video encod- 
ing parameters. 

At step #1824 the audio maietiai start time VOB_AST of each VOB is extracted from the scenario data St7, and the 
audio encode start time A STTM is set as an audio encoding parameter. 

At step #1826 the audio material end time VOB_AEND is extracted for each VOB from the scenario data St7, and 
at a time not exceeding the V3E_ AEND time This time extiacted at an audio access unit (AAU) is set as the audio 
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encode end time A_ENDTM which is an audio encoding parameter Note that the audio access unit AAU is detei mined 
by the audio encoding method. 

At step #1828 the audio start gap A STGAP obtained from the difference between the video encode start time 
V_STTM and the audio encode start time A_STTM is delined as a system encode parameter. 
£ At step #1830 the audio end gap AENDGAP obtained trom the difference between the video encode end time 

V_ENDTM and the audio encode end time AENDTM is defined as a system encode parameter. 

At step #1832 the video encoding bit rate VJ3R is extracted Irom the scenario data St7, and the video encode bit 
rate V_RATE. which is the average bit rate of video encoding, is set as a video encoding parameter. 

At step #1834 the audio encoding bit rate A BR is extracted Irom the scenario data St7. and the audio encode bit 
w rate A_RATE is set as an audio encoding parameter. 

At step #1836 the video material type VOB_V_KIND is extracted trom the scenario data St7. It the material is a tilm 
type. i.e.. a movie converted to television broadcast tormat (so-called telecine conversion), reverse telecine conversion 
is set lor the video encode mode V_EiMCMD. and detined as a video encoding parameter. 

At step #1838 the audio coding method VOB_A_KIND is extracted trom the scenario data St7, and the encoding 
is method is set as the audio encode method A_ENCMD and set as an audio encoding parameter . 

At step #1840 the initial video encode data V_INTST sets the initial value of the VBV buffer to a value less than the 
VBV buffer end value set by the last video encode data VENDST. and defined as a video encoding parameter. 

At step #1842 the VOB number VOB_NO of the preceding connection is set to the preceding VOB number 
B_VOB_NO based on the setting (= 1) of the preceding VOB seamless connection flag VOB_Fsb. and set as a system 
20 encode parameter. 

At step #1844 the VOB number VOB_NO of the following connection is set to the following VOB number 
F_VOB_NO based on the setting {= 1) of the following VOB seamless connection flag VOB_Fsf. and set as a system 
encode parameter. 

The encoding information table and encode parameters are thus generated for a multi-angle VOB Set with non- 
25 seamless multi-angle switching control enabled. 

The process for generating the encode parameters of a seamless switching stream with multi-angle control is 
described below with reference to Fig. 54. This stream is generated when step #1500 in Fig. 51 returns YES and the 
following flags are set as shown: VOB_Fsb = 1 or VOB_Fsf = 1 . VOB_Fp = 1 . VOB_Fi = 1 . VOB_Fm = 1 . and VOB_FsV 
= 1. The following operation produces the encoding information tables shown in Fig. 27 and Fig. 28, and the encode 
30 parameters shown in Fig. 29. 

The following operation produces the encoding information tables shown in Fig. 27 and Fig. 28, and the encode 
parameters shown in Fig. 29. 

At step #1850, the scenario reproduction sequence (path) contained in the scenario data St7 is extracted, the VOB 
Set number VOBS_NO is set, and the VOB number VOB_NO is set for one or more VOB in the VOB Set. 
25 At step #1852 the maximum bit rate ILV_BR of the interleaved VOB is extracted from the scenario data St7, and the 

maximum video encode bit rate V_MR ATE from the encode parameters is set based on the interleave flag VOB_Fi set- 
ting (= 1). 

' At step #1854, the minimum interleaved unit presentation time ILVU_MT is extracted from the scenario data St7. 
At step #1856, the video encode GOP structure GOPST values N = 15 and M = 3 are set, and the GOP structure 
40 fixing flag GOP_Fxflag is set (= i). based on the multi-scene flag VOB_Fp setting (= 1). 

At step #1858, the video encode GOP GOPST is set to 'closed GOP" based on the multi-angle seamless switching 
flag VOB_FsV setting (= 1). and the video encoding parameters are thus defined. 

Step #1860 is the common VOB data setting routine, which is as described referring to the flow chart in Fig. 52. 
Further description thereof is thus omitted here. 
45 The encode parameters of a seamless switching stream with multi-angle control are thus defined for a VOB Set 

with multi-angle control as described above. 

The process for generating the encode parameters for a system stream in which parental lock control is imple- 
mented is described below with reference to Fig. 55. This stream is generated when step #1200 in Fig. 51 returns NO 
and step #1304 returns YES, i.e., the following flags are set as shown: VOB_Fsb = 1 or VOB_Fsf = 1, VOB_Fp = 1, 
50 VOB_Fi = 1, VOB_Fm = 0. The following operation produces the encoding information tables shown in Fig. 27 and Fig. 
28, and the encode parameters shown in Fig. 29. 

At step #1870, the scenario reproduction sequence (path) contained in the scenario data St7 is extracted, the VOB 
Set number VOBS_NO is set, and the VOB number VOB_NO is set for one or more VOB in the VOB Set. 

At step #1872 the maximum bit rate !LV_BR of the interleaved VOB is extracted from the scenario data S17. and the 
55 maximum video encode bit rate V_MRATE from the encode parameters is set based on the interleave flag VOE_Fi set- 
ting (= 1). 

At step #1872 the number of interleaved VOB divisions !LV_DIV is extracted from the scenario data St7. 

Step #1876 is the common VOB data setting routine, which is as described referring to the flow chart in Fic. 52. 
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Furthei description thereof is thus omitted heie 

The encode paiameteis o1 a system si i earn in which parental lock contiol is implemented are thus defined for a 
VOB Set with multi-scene selection contiol enabled as described above 

The piocess toi generating the encode paiameteis loi a system stieam containing a single scene is described 
below with leteience to Fig. 61. This stream is generated when step #900 in Fig. 51 returns NO. i.e.. when VOB_Fp=0. 
The following operation produces the encoding information tables shown in Fig. 27 and Fig. 26. and the encode param- 
eters shown in Fig 29. 

At step#iS80. the scenario reproduction sequence (path) contained in the scenario data St7 is extracted, the VOB 
Set number VOBS_NO is set. and the VOB numbei VOB_NO is set for one or more VOB in the VOB Set. 

At step #1 882 the maximum bit rate ILV BR of the interleaved VOB is extracted from the scenario data St7. and the 
maximum video encode bit rate V MRAT b from the encode parameters is set based on the interleave flag VOB_Fi set- 
ting (=1). 

Step #1884 is the common VOB data setting routine, which is as described referring to the flow chart in Fig. 52. 
Further description thereof is thus omitted here. 

These flow chaits lor defining the encoding information table and encode parameters thus generate the parameters 
for DVD video, audio, and system stieam encoding by the DVD formatter 

Forma tt er fl^ ws 

The opotato^ of the subroutine executed by the DVD formatter shown as step #2300 in Fig. 51 B is described next 
with rete eoce to f *gi 56. 57, 58. 59, and 60. This formatter subroutine generates the DVD multimedia bitstream. 

Th* oc**a:>or ot the DVD encoder ECD 1 100 according to the present invention is described with reference to the 
flow cr~A'i r * ,g Mote that those steps shown in Fig. 56 with a double line are subroutines. 

A? o-r w? * ir tr*» nooiam chain information VTS_PGCI is set to the VTSI management table VTSI_MAT for the 
nurrr** m *. , ? 7- ? *Ji JM based on the number of titles TITLE_NUM in the VOB Set data stream. 

a? v^t: «rT; ^ r « ««, ovet mined whether multi-scene selection control is enabled based on the multi-scene flag 
VOB f ; %* *\ > oata stream. If step #2312 returns NO. i.e.. multi-scene control is not enabled, the procedure 

move, t * • 4 

Ar v*n -4 r*- au**at>on foi coding a single scene (VOB) executed by the formatter 1100 of the authoring 
enco>« I . >^r*j**~ r * ?!> is accomplished. This routine is described later. 

r tr^ ' ."• • ^ > l S i e.. multi-scene control is enabled, the procedure moves to step #21 16. 

A; «v • ••. «i ^ iz^x^r^ned whether the information is to be interleaved or not based on the interleave flag 
VOE * i" rv s. ~- ^ata stream. If step #2316 returns NO. i.e.. the information is not to be interleaved, the 

proc*;**- ^v^— „ tc «C2i4 h step #2316 returns YES, i.e.. the information is to be interleaved, the procedure 
move. tc it-a. *T?. • S 

A: v»v *r?i = <? *% o****rymed whether multi-angle control is to be implemented based on the multi-angle flag 
VOE I ^ t V fc i>** stieam. If step #2318 returns NO, the parental lock control routine in step #2320 is exe- 
cutec k stec C2 i f v t S. the procedure moves to step #2322. 

A: tr* a^taTon tor formatting the VOB Set for parental lock control is executed. This subroutine is 

show^ ► *5 * -* and o^r»cj t>ea below. 

At s?**; c a«*e» mined wnether multi-angle seamless switching is required based on the multi-angle seam- 

less sw:T^nmg !w*c vOl: * :* v « nvrtti-angle switching is accomplished without seamless switching, i.e.. with non-seam- 
less b^'tJioy dru i»t-v er2ri > fetums NO. the procedure moves to step #2326. 

The multi-angle nc»^ *^armess switching control routine executed in step #2326 by the formatter 1 100 of the author- 
ing encodet CC tn Tig ri; * aesc-'ibed later with reference to Fig. 57. 

11 murti-angie switcMng rs accomplished with seamless switching control, i.e.. step #2322 returns YES, the proce- 
dure moves to step <?3P4 

The multi angle seamless switching control routine executed in step #2324 by the formatter 1 100 of the authoring 
encoder EC in Fig 25 is described later with reference to Fig. 58. 

The cell playback mfc*mation (PCG information entries C_PBI) of the VTS information VTSI set as previously 
described is then recorded 

At step #2330 it is determined whether all VOB Sets declared by the VOB Set number VOBS_NUM have been 
processed by the formatter If NC. control loops back to step #2312. and the process runs again. H YES, all sets have 
been formatted, the procedure terminates. 

Referring to Fig. 57. the multi-angle non-seamless switching control routine executed in step #2326 when step 
#2322. Fig. 56, returns NO is describee. This routine defines the interleaved arrangement of the multimedia bitstream 
MBS. the content of the cell playback information (C_PBI#i) shown in Ftg. 16, and the information stored to the naviga- 
tion pack NV shown in Fig. 20. in the generated DVD multimedia bitstream MBS. 
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At step #2340 based on the mulli-angle llag VOB_Fm setting 1) declaring whethei multi-angle control is applied 
in the multi-scene period, the cell block mode CBM (Fig. 16) ot the cell playback information blocks C_PBI #i containing 
the VOB control information loi each scene is declaied according to the position ot the angle data. Foi example, the cell 
block mode CBM ol the MAI cell (Fig. 33) is declai ed as 01 b to indicate the beginning ot the cell block, the CBM ol MA2 
t is declared as 10b to indicate a cell between the tirst and last cells in the block, and the CBM ot MA3 is declared as 1 lb 
to indicate the end ot the cell block. 

At step #2342 based on the multi-angle llag VOB Fm setting (= 1) declaring whethei multi-angle control is applied 
in the multi-scene period, the cell block type CBT (Fig. 16) of the cell playback information blocks C_PBI #i containing 
the VOB control information foi each scene is declaied as 01b to indicate an "angle." 
w At step #2344 the seamless playback flag SPF (Fig. 16) is set to 1 in the cell playback information blocks C_PBI #i 

containing the VOB control inlormation tor each scene based on the preceding VOB seamless connection llag 
VOB_Fsb state, which is set to 1 to indicate a seamless connection. 

At step #2346 the STC resetting flag STCDF is set to i in the cell playback information blocks C_PBI #i containing 
the VOB control information for each scene based on the preceding VOB seamless connection flag VOB_Fsb state. 
15 which is set to 1 to indicate a seamless connection. 

At step #2348 the interleaved allocation flag IAF (Fig. 16) is set to 1 in the cell playback information blocks C_PBI 
#i containing the VOB control information for each scene based on the muiti -angle seamless switching flag VOB_FsV 
state, which is set to 1 to indicate interleaving is required. 

At step #2350 the location of the navigation pack NV (relative sector number from the VOB beginning) is detected 
20 from the title editing unit (VOB below) obtained from the system encoder 900 in Fig. 25, the navigation pack NV is 
detected based on the minimum interleaved unit presentation time ILVU_MT information (a formatter parameter 
obtained in step #1816. Fig. 51), the location of the VOBU expressed as the number of sectors from the VOB beginning, 
for example, is thus obtained, and the title editing unit VOB is divided into interleave units using VOBU units. 

For example, rf in this example the minimum interleaved unit presentation time ILVU_MT is 2 sec and the presen- 
ts tation time of one VOBU is 0.5 sec. then the VOB is divided into interleave units of 4 VOBU each. Note that this alloca- 
tion operation is applied to the VOB constituting each multi-scene data unit. 

At step #2352 the interleave units of each VOB obtained from step #2350 are arranged in the cell block mode CBM 
sequence (cell block beginning, middle, and end cells) written as the VOB control information for each scene in step 
#2340 to form the interleaved blocks as shown in Fig. 37 or 38. The interleaved blocks are then added to the VTS title 
30 VOBS (VTSTT_VOBS). Using the cell block mode CBM declarations above, for example, the angle data MAI. MA2. 
and MA3 (Fig. 23) are arranged in that sequence. 

At step #2354 the relative sector number from the VOBU start is written to the'VOB end pack address VOBU_EA 
(Fig. 20) in the navigation pack NV of each VOBU based on the VOBU position information obtained in step #2350. 
At step #2356 the first cell VOBU start address C_FVOBU_SA and the last cell VOBU start address C_LVOBU_SA 
25 expressed as the number of sectors from the beginning of the VTS title VOBS (VTSTT_VOBS) are written as the 
addresses of the navigation packs NV of the first and last VOBU in each cell based on the VTS title VOBS 
(VTSTT_VOBS) data obtained in step #2352. 

The angle #i VOBU start address NSM L_ AG L_C 1 _ DSTA - NSML_AGL_C9_DSTA ot the non-seamless angle 
inlormation NSML_AGLI (Fig. 20) in the navigation pack NV of each VOBU is written at step #2358. This address is 
40 expressed as the relative sector number inside the data of the interleaved blocks formed in step #2352, and declares 
the address information (Fig. 50) of the navigation pack NV contained in the VOBU of all angle scenes near the pres- 
entation start time of the VOBU being processed. 

At step #2360 "7FFFFFFFh" is written to the angle #i VOBU start address NSML_AGL_Cl_DSTA - 
NSML_AGL_C9_DSTA of the non-seamless angle information NSML_AGLI (Fig. 20) in the navigation pack NV of each 
45 VOBU if the VOBU being processed is the last VOBU of each scene in the multi -scene period. 

This routine thus formats the interleaved blocks for multi-angle non-seamless switching control in the multi-scene 
period, and formats the cell control information as the reproduction control information for those multiple scenes. 

Referring to Fig. 58, the multi-angle seamless switching control routine executed in step #2324 when step #2322, 
Fig. 56, returns YES is described. This routine defines the interleaved arrangement of the multimedia bitstream MBS, 
50 the content of the cell playback information (C_PBI#i) shown in Fig. 16. and the information stored to the navigation 
pack NV shown in Fig. 20, in the generated DVD multimedia bitstream MBS. 

At step #2370 based on the mufti-angle flag VOB_Fm setting (= 1) declaring whether multi-angle control is applied 
in the multi-scene period, the cell block mode CBM (Fig. 16) of the cell playback information blocks C_PBI #i containing 
the VOB control information for each scene is declared according to the position of the angle data. For example, the cell 
as block mode CBM of the MAI cell (Fig. 23) is declared as 01b to indicate the beginning of the cell block, the CBM of MA2 
is declared as 10b to indicate a cell between the first and last cells in the block, and the CBM of MA3 is declared as lib 
to indicate the end of the cell block. 

At step #2372 based on the multi-angle flag VOE_Fm setting (= 1) declaring whethei multi-angle control is applied 
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in the multi-scene penod. Ihe cell block type CBT (Fig 16) o1 the cell playback information blocks C_PBI #i containing 
the VOB control information for each scene is. declaied as 01b to indicate an angle " 

At step #2374 the seamless playback Hag SPF (Fig. 16) is set to 1 in the cell playback information blocks C_PBI #i 
containing the VOB contiol info?mation toi each scene based on the pieceding VOB seamless connection flag 
VOB_Fsb state, which is set to 1 to mdicale a seamless connection. 

At step #2376 the STC resetting flag ST CDF is set to 1 in the cell playback information blocks C_PBI #i containing 
the VOB control information for each scene based on the preceding VOB seamless connection flag VOB_Fsb state, 
which is set to 1 to indicate a seamless connection. 

At step #2378 the interleaved allocation flag IAF (Fig. 16) is set to 1 m the cell playback information blocks C_PBI 
#i containing the VOB control information foi each scene based on the multi-angle seamless switching flag VOB_FsV 
state, which is set to 1 to indicate intei leaving is required. 

At step #2380 the location of the navigation pack NV (relative sectoi number from the VOB beginning) is detected 
from the title editing unit (VOB below) obtained from the system encode! 900 in Fig. 25. the navigation pack NV is 
detected based on the minimum interleaved unit presentation time ILVU_MT information (a formatter parameter 
obtained in step #1 854. Fig. 53). the location of the VOBU expiessed as the numbei of sectois from the VOB beginning, 
for example, is thus obtained, and the title editing unit VOB is divided into inter leave units using VOBU units. 

For example, if in this example the minimum interleaved unit presentation time ILVU_MT is 2 sec and the presen- 
tation time of one VOBU is 0.5 sec. then the VOB is divided into interleave units of 4 VOBU each. Note that this alloca- 
tion operation is applied to the VOB constituting each multi-scene data unit. 

At step #2382 the inter leave units of each VOB obtained from step #2380 are arranged in the cell block mode CBM 
sequence (cell block beginning, middle, and end cells) written as the VOB control information for each scene in step 
#2360 to form the interleaved blocks as shown in Fig. 37 or 38. The interleaved blocks are then added to the VTS title 
VOBS (VTSTT_VOBS). Using the cell block mode CBM declarations above, for example, the angle data MAI. MA2, 
and MAS (Fig. 23) are arranged in that sequence. 

At step #2384 the relative sector number from the VOBU start is written to the VOB end pack address VOBU_EA 
(Fig. 20) in the navigation pack NV of each VOBU based on the VOBU position information obtained in step #2360. 

At step #2386 the first cell VOBU start address C_FVOBU_SA and the last cell VOBU start address C_LVOBU_SA 
expressed as the number of sectors fiom the beginning of the VTS title VOBS (VTSTT_VOBS) are written as the 
addresses of the navigation packs NV ol the first and last VOBU in each cell based on the VTS title VOBS 
(VTSTT_VOBS) data obtained in step #2382. 

At step #2388 the relative sector number from the VOBU start is written to the VOB end pack address VOBU_EA 
(Fig. 20) in the navigation pack NV of each VOBU based on the interleave unit data obtained in step #2370. 

The angle #i VOBU start address SML_AGL_Cl_DSTA - S M L_ AG L_ C 9_ D S TA of the seamless angle information 
SML_AGLI (Fig. 20) in the navigation pack NV ol each VOBU is written at step #2390. This address is expressed as the 
relative sector number inside the data of the interleaved blocks lormed in step #2382, and declares the address infor- 
mation (Fig. 50) of the navigation pack NV contained in the VOBU of all angle scenes with a start time contiguous to 
the reproduction end time of the VOBU being processed. 

At step #2392 "7FFFFFFFh" is written to the angle #i VOBU start address SM L_ AGL_C 1 __D STA - 
SML_AGL_C9_DSTA of the seamless angle information SML_AGLl (Fig. 20) in the navigation pack NV of the VOBU 
contained in the interleaved unit if the interleave unit arranged in step #2382 is the last interleave unit of each scene in 
the multi-scene period. 

This routine thus formats the interleaved blocks for multi-angle seamless switching control in the multi-scene 
period, and formats the cell contiol infoimation as the reproduction control information for those multiple scenes. 

The parental lock subroutine (step #2320, Fig. 56) executed when step #2318 in Fig. 56 returns NO, i.e., when it is 
determined that parental lock control is implemented and not multi-angle control, is described next with reference to Fig. 
59. 

The parental lock subroutine described below writes the interleave unit arrangement of the multimedia bitstream, 
the content of the PGC information entries C_PBI #i (cell playback information) shown in Fig. 16, and the navigation 
pack NV information shown in Fig. 20, to the generated DVD multimedia bitstream. 

At step #2402 a value *00b" is written to the cell block mode CBM (Fig. 16) of the cell playback information blocks 
C_PBI #i containing the VOB control information for each scene based on the multi-angle flag VOB_Fm state, which is 
set to 0 to indicate that multi-angle control is not enabled in the multi-scene period. 

At step #2404 the seamless playback flag SPF (Fig. 16) is set to 1 in the cell playback information blocks C_PB1 #i 
containing the VOB control information for each scene based on the preceding VOB seamless connection flag 
VOB_Fsb state, which is set to 1 to indicate a seamless connection. 

At step #2406 the STC resetting flag STCDF is set to 1 in the cell playback information blocks C_PBI #i containing 
the VOB control information for each scene based on the preceding VOE seamless connection flag VOB_Fsb state, 
which is set to 1 to indicate a seamless connection. 
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A1 step #2408 the interleaved allocation flag IAF (Fig. 16) is set to i in the cell playback information blocks C_PBI 
#i containing the VOB contiol inloimation loi each scene based or. the multi-angle seamless switching flag VOB_FsV 
state, which is set to 1 to indicate interleaving is lequited. 

At step #2410 the navigation pack NV position intoimation (the lelative sectoi numbei from the VOB start) is 
£ detected from the title editing unit (VOB) obtained from the system encodei 900 (Fig. 25). The navigation pack NV is 
then detected based on the numbei ol interleaved VOBdivisions ILV_DIV. a foi mattei parameter obtained in step #1874 
in Fig. 55. to obtain the VOBU position information (numbei of sectors from the VOB start), and divide each VOB into 
the specified number of interleave units in VOBU units. 

At step #2412 the interleave units obtained in step #2410 are then interleaved. Foi example, the interleave units 
io are arranged in ascending VOB number sequence to create the interleaved blocks as shown in Fig. 37 or 38. and the 
interleaved blocks aie added to the VTS title VOBS (VTSTT_VOBS). 

At step #2414 the relative sector numbei from the VOBU start is written to the VOB end pack address VOBU_EA 
(Fig. 20) in the navigation pack NV of each VOBU based on the VOBU position intoimation obtained in step #2186. 

At step #2416 the first cell VOBU start addiess C_FVOBU_SA and the last cell VOBU start address C_LVOBU_SA 
75 expressed as the numbei of sectoi s fiom the beginning of the VTS title VOBS (VTSTT_VOBS) are written as the 
addi esses of the navigation packs NV of the fiist and last VOBU in each cell based on the VTS title VOBS 
(VTSTT_VOBS) data obtained in step #2412. 

At step #2418 the relative sectoi number to the last interleave unit pack is wiitten to the ILVU end pack address 
ILVU_EA in the navigation pack NV of the VOBU forming the interleaved units based on the interleaved unit data 
20 obtained from step #24 1 2. 

At step #2420, the relative sectoi number in the interleaved block data formed in step #2412 is written to the next- 
ILVU start address NT_1LVU_SA as the position information of the next ILVU in the navigation packs NV of the VOBU 
contained in the interleaved unit ILVU. 

At step #2422 the interleaved unit flag ILVU flag is set to 1 in the navigation packs NV of the VOBU contained in the 
25 interleaved unit ILVU. 

At step #2424. the Unit END flag of the navigation pack NV in the last VOBU of the interleaved unit ILVU is set to 1 . 

At step #2426 "FFFFFFFFh" is written to the next-ILVU start address NTJLVU_SA of the navigation pack NV of the 
VOBU in the last interleaved unit ILVU of each VOB. 

The operation described above thus formats the interleaved blocks to enable parental lock control in the multi- 
30 scene periods, and formats the control information in the cells, i.e., the cell playback control information for the multi- 
scene periods. 

The single scene subroutine executed as step #2314 in Fig. 56 when steps #2312 or #2316 return NO, i.e. . when 
the scene is determined to be a single scene and not a multi-scene period, is described next using Fig. 60. 

The single scene subroutine desciibed below writes the interleave unit arrangement of the multimedia bitstream, 
35 the content of the PGC information entries C_PBI #i (cell playback information) shown in Fig. 16, and the navigation 
pack NV information shown in Fig. 20, to the generated DVD multimedia bitstream. 

At step #2430 a value "OOb" indicating a "non-cell block', i.e., that there is only one cell in the functional block, is 
written to the cell block mode CBM (Fig. 16) of the cell playback information blocks C_PBI #i containing the VOB control 
information tor each scene based on the multi-scene flag VOB_Fp state, which is set to 0 to indicate that the scene is 
ao a single scene and not part of a multi-scene period. 

At step #2432 the interleaved allocation flag IAF (Fig. 16) is set to 0 in the cell playback information blocks C_PBI 
#i containing the VOB contiol information for each scene based on the multi-angle seamless switching flag VOB_FsV 
state, which is set to 0 to indicate interleaving is not required. 

At step #2434 the navigation pack NV position information (the relative sectoi number from the VOB start) is 
<5 detected from the title editing unit (VOB) obtained from the system encoder 900 (Fig. 25), placed in the VOBU unit, and 
added to the VTS title VOBS (VTSTT_VOBS), the video and other stream data of the multimedia bitstream. 

At step #2436 the relative sector number from the VOBU start is written to the VOB end pack address VOBU_EA 
(Fig. 20) in the navigation pack NV of each VOBU based on the VOBU position information obtained in step #2434. 

At step #2438 the first cell VOBU start address C_FVOBU_SA and the last cell VOBU start address CJ-VOBU_SA 
ao expressed as the number of sectors from the beginning of and the end of, respectively, the VTS title VOBS 
(VTSTT_VOBS) of the value written as the addresses of the navigation packs NV of the first and last VOBU in cell 
based on the VTS title VOBS (VTSTT_VOBS) data obtained in step #2434. 

At step #2440 the state determined as a result of step #300 or #600 in Fig. 51 , i.e., whether preceding VOB seam- 
less connection flag VOB_Fsb is set to 1 indicating a seamless connection to the preceding or following scenes, is eval- 
55 uated. If step #2440 returns YES. the procedure moves to step #2442. 

At step #2442 the seamless playback flag SPF (Fig. 16) is set to 1 in the cell playback information blocks C_PBI #i 
containing the VOB control information for each scene based on the preceding VOB seamless connection flag 
VOB_Fsb state, which is set to 1 to indicate a seamless connection. 
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At step #2444 the STC lesettrng flag PI CD I it t.H to 1 in the cell playback information blocks C_ PBl #i containiny 
the VOB control information for each scene based on the preceding VOB seamless connection flag VOBFsb state, 
which is set to 1 . 

If step #2440 returns NO. i.e.. theie is not a seamless connection to the pieceding scene, the procedure moves to 
step #2446. 

At step #2446 the seamless playback flag SPF (Fig 16) is set to 0 in the cell playback information blocks C_ PBl #i 
containing the VOB control information foi each scene based on the preceding VOB seamless connection llag 
VOB_Fsb state, which is set to 0 to indicate a non-seamless connection. 

At step #2448 the STC resetting flag STCDF is set to 0 in the cell playback information blocks C_PBI #i containing 
the VOB control information for each scene based on the pieceding VOB seamless connection flag VOB_Fsb state, 
which is set to 0. 

The operation desciibed above thus tor mats a multimedia bitstream for a single scene period, and records the con- 
trol information in the cells, i.e.. the cell playback contiol information (C_PBI #i. Fig. 16). and the information in the nav- 
igation pack NV (Fig. 20), to the produced DVD multimedia bitstream. 

Pec rtei flew chart s 

Disk-to-stream butter transfer flow 

The decoding information table produced by the decoding system controller 2300 based on the scenario selection 
data St51 is described below referring to Figs. 62 and 63. The decoding information table comprises the decoding sys- 
tem table shown in Fig. 62, and the decoding table shown in Fig. 63. 

As shown in Fig. 62, the decoding system table comprises a scenario information registei and a cell information 
register. The scenario information register records the title number and other scenario reproduction information 
selected by the user and extracted from the scenario selection data St51. The cell information register extracts and 
records the information required to reproduce the cells constituting the program chain PGC based on the user-defined 
scenario information extracted into the scenario information register. 

More specifically, the scenario information register contains plural sub-registers, i.e., the angle number 
ANGLE_NO_reg. VTS number VTS_NO_reg. PGC number VTS_PGCI_NO_reg. audio ID AUDIO_ID_reg, sub-picture 
ID SP_ID_reg, and the system clock reference SCR buffer SCR_buffer. 

The angle number ANGLE_NO_reg stores which angle is reproduced when there are multiple angles in the repro- 
duction program chain PGC. 

The VTS number VTS_NO_reg records the number of the next VTS reproduced from among the plural VTS on the 
disk. 

The PGC number VTS_PGCI_NO_reg records which of the plural program chains PGC present in the video title 
set VTS is to be reproduced for parental lock control or other applications. 

The audio ID AUDIO_ID_reg records which of the plural audio streams in the VTS are to be reproduced. 

The sub-picture ID SP JD_reg records which of the plural sub-picture streams is to be reproduced when there are 
plural sub-picture streams in the VTS. 

The system clock reference SCR buffer SCR_butfer is the buffer for temporarily storing the system clock reference 
SCR recorded to the pack header as shown in Fig. 19. As described using Fig. 26. this temporarily stored system clock 
reference SCR is output to the decoding system controller 2300 as the bitstream control data St63. 

The cell information register contains the following sub-registers: the cell block mode CBM_reg, cell block type 
CBT_reg, seamless reproduction flag SPF_reg, interleaved allocation flag IAF_reg, STC resetting flag STCDF, seam- 
less angle change flag SACF__reg. first cell VOBU start address C_FVOBU_SA_r eg, and last cell VOBU start address 
C_LVOBlLSA_reg. 

The cell block mode CBM_reg stores a value indicating whether plural cells constitute one functional block. If there 
are not plural cells in one functional block, CBM_reg stores N_BLOCK. If plural cells constitute one functional block, the 
value F_CELL is stored as the CBM_reg value of the first cell in the block, L_CELL is stored as the CBM_reg value of 
the last cell in the block and BLOCK is stored as the CBM_reg of value all cells between the first and last cells in the 
block. 

The cell block type CBT_reg stores a value defining the type of the block indicated by the cell block mode CBM_reg. 
If the cell block is a multi-angle block. A_ BLOCK is stored; if not. N_BLOCK is stored. 

The seamless reproduction flag SPF_reg stores a value defining whether that cell is seamless connected with the 
cell or cell block reproduced therebefore. If a seamless connection is specified, SML is stored; if a seamless connection 
is not specified, NSML is stored. 

The interleaved allocation flag IAF__reg stores a value identifying whether the cell exists in a contiguous or inter- 
leaved block. II the cell is part of a an interleaved block. ILVB is stored; otherwise NJLVE is stored. 
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The STC resetting llag STCDF defines whethei the system time clock STC used foi synchronization must be reset 
when the cell is reproduced; when resetting the system time clock SIC is necessary. ST C_ RE SET is stored; it resetting 
is not necessary. STC_NRESET is stored. 

The seamless angle change llag SACF_reg stoies a value indicating whether a cell in a multi-angle period should 
£ be connected seamlessly at an angle change. If the angle change is seamless, the seamless angle change llag SACF 
is set to SML; otherwise it is set to NSML. 

Thelirst cell VOBU start address C_FVOBU_SA_ieg stores the VOBU start address ol the first cell in a block. The 
value ol this address is expressed as the distance Irom the logic sector of the first cell in the VTS title VOBS 
(VTSTT_VOBS) as measured by and expressed (stored) as the number of sectors. 
10 The last cell VOBU start address C_LVOBU_SA_r eg stor es the VOBU start address of the last cell in the block The 

value ol this address is also expressed as the distance Irom the logic sector of the first cell in the VTS title VOBS 
(VTSTT_VOBS) measured by and expressed (stor ed) as the number ot sectors. 

The decoding table shown in Fig. 63 is described below. As shown in Fig. 63. the decoding table comprises the fol- 
lowing registers: information registers for non-seamless multi-angle control, information registers tor seamless multi- 
75 angle control, a VOBU infor mation register, and information registers for seamless reproduction. 

The information registers for non-seamless multi -angle contiol comprise sub-registers 
NSML_AGL_Cl_DSTAlreg - N SM L_ AGL_C 9_ D STA_ reg . 

N SM L_AGL_C 1 _D STA_r eg - NSML_AGL_C9__DSTA_reg record the NMSL_AGL_Cl_DSTA 
NMSL_AGL_C9_DSTA values in the PCI packet shown in Fig. 20. 
20 The information registers for seamless multi -angle control comprise sub-registers 

SML_AGL_C 1 _DSTA_reg - SML_AGL_C9_DSTA_reg. 

SM L_ AGL_C 1 _D STA_reg - SML_AGL_C9_D STA_reg record the SML_AGL_Cl_DSTA - SML_AGL_C9_DSTA 
values in the DSI packet shown in Fig. 20. 

The VOBU information register stores the end pack address VOBU_EA in the DSI packet shown in Fig. 20. 
25 The information registers for seamless reproduction comprise the following sub- registers: an interleaved unit flag 

ILVUJIag_reg. Unit END flag UNIT_END_flag_reg. Interleaved Unit End Address ILVU_EA_reg. Next Interleaved Unit 
Start Address NT_ILVU_SA_reg. the presentation start time of the first video frame in the VOB (Initial Video Frame 
Presentation Start Time) VOB_V_SPTM_reg. the presentation end time of the last video frame in the VOB (Final Video 
Frame Presentation Termination Time) VOB_V_EPTM_reg, audio reproduction stopping time 1 
so VOB_A_STP_PTM1_reg, audio reproduction stopping time 2 VOB_A_STP_PTM2_reg, audio reproduction stopping 
period 1 VOB_A_GAP_LEN1_reg. and audio reproduction stopping period 2 VOB_A_GAP_LEN2_reg. 

The interleaved unit flag ILVUJIag_reg stores the value indicating whether the video object unit VOBU is in an 
interleaved block, and stores ILVU if it is, and NJLVU if not. 

The Unit END flag UNIT_END_flag_reg stores the value indicating whether the video object unit VOBU is the last 
35 VOBU in the interleaved unit ILVU. Because the interleaved unit ILVU is the data unit for continuous reading, the 
UNIT_ENDJIag_reg stores END if the VOBU currently being read is the last VOBU in the interleaved unit ILVU, and 
otherwise stores N_END. 

The Interleaved Unit End Address ILVU_EA_reg stores the address of the last pack in the ILVU to which the VOBU 
belongs if the VOBU is in an interleaved block. This address is expressed as the number ol sectors from the navigation 
<o pack NV of that VOBU. 

The Next Interleaved Unit Start Address NTJLVU_SA_reg stores the start address ol the next interleaved unit ILVU 
if the VOBU is in an interleaved block. This address is also expressed as the number of sectors from the navigation pack 
NV of that VOBU. 

The Initial Video Frame Presentation Start Time register VOB_V_SPTM_reg stores the time at which presentation 
45 of the first video frame in the VOB starts. 

The Final Video Frame Presentation Termination Time register VOB_V_EPTM_reg stores the time at which pres- 
entation of the last video frame in the VOB ends. 

The audio reproduction stopping time 1 VOB_A_STP_PTMl_reg stores the time at which the audio is to be paused 
to enable resynchroni2ation, and the audio reproduction stopping period 1 VOB_A_GAP_LENl_reg stores the length 
50 of this pause period. 

The audio reproduction stopping time 2 VOB_A_STP_PTM2_reg and audio reproduction stopping period 2 
VOB_A_GAP_LEN2_reg store the same values. 

The operation of the DVD decoder DCD according tc the present invention as shown in Fig. 26 is described next 
below with reference to the flow chart in Fig. 69. 
55 At step #310202 it is first determined whether a disk has been inserted. If it has. the procedure moves to step 

#310204. 

At step #310204, the volume file structure VFS (Fig. 21) is read, and the procedure moves to step #310206. 

At step #310206, the video manager VMG (Fig. 21) is read and the video title set VTS to be reproduced is 
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extracted "I he proceduie then moves, to step #310208 

At step #310208. the video title ret menu address mtoimation VTSM C. ADT is extiacted from the VTS information 
VTS1. and the procedure moves to step #310210. 

At step #310210 the video title set menu VTSM_ VOBS is read tiom the disk based on the video title set menu 
address inlormation VTSM_C_ADT. and the title selection menu is presented 

The user is thus able to select the desued title ttom this menu in step #310212. It the titles include both contiguous 
titles with no user -selectable content, and titles containing audio numbers, sub-picture numbers, or multi-angle scene 
content, the user must also entei the desired angle number. Once the usei selection is completed, the procedure 
moves to step #310214. 

At step #31021 4. the VTS_PGCI #i program chain (PGC) data block coi responding to the title number selected by 
the usei is extracted tiom the VI SPGC information table VTS_PGCIT. and the proceduie moves to step #310216. 

Reproduction of the program chain PGC then begins at step #310216. When program chain PGC reproduction is 
finished, the decoding process ends. If a separate title is thereafter to be reproduced as determined by monitoring key 
entry to the scenario selector, the title menu is presented again (step #310210). 

Program chain reproduction in step #310216 above is desci ibed in further detail below referring to Fig. 64. The pro- 
gram chain PGC reproduction routine consists o1 steps #31030. #31032, #31034, and #31035 as shown. 

At step #31030 the decoding system table shown in Fig. 62 is defined. The angle number A NG L E_NO_ reg , VTS 
number VTS_NO_reg. PGC number VTS_PGCI_NO_reg, audio ID AUDIO_ID_reg, and sub-picture ID SP_ID_reg are 
set according to the selections made by the user using the scenario selector 2100. 

Once the PGC to be r eproduced is determined, the corresponding cell information (PGC information entries C_PBI 
#j) is extracted and the cell information register is defined. The sub-registers therein that are defined are the cell block 
mode CBM_reg, cell block type CBTjeg, seamless reproduction flag SPF_reg, interleaved allocation flag IAF_reg, 
STC resetting flag STCDF, seamless angle change flag SACF_reg, first cell VOBU start addr ess C_FVOBU_SA_reg. 
and last cell VOBU start address C_LVOBU_SA_reg. 

Once the decoding system table is defined, the process transferring data to the stream buffer (step #31032) and 
the process decoding the data in the stream buffer (step #31034) are activated in parallel. 

The process transferring data to the stream buffer (step #31 032) is the process of transferring data from the record- 
ing medium M to the stream buffer 2400. This is. therefore, the processing of reading the required data from the record- 
ing medium M and inputting the data to the stream buffer 2400 according to the user-selected title information and the 
playback control information (navigation packs NV) written in the stream. 

The routine shown as step #31034 is the process for decoding the data stored to the stream buffer 2400 (Fig. 26), 
and outputting the decoded data to the video data output terminal 3600 and audio data output terminal 3700. Thus, is 
the process for decoding and reproducing the data stored to the stream buffer 2400. 

Note that step #31032 and step #31034 are executed in parallel. 

The processing unit of step #31032 is the cell, and as processing one cell is completed, it is determined in step 
#31035 whether the complete program chain PGC has been processed. If processing the complete program chain 
PGC is not completed, the decoding system table is defined for the next cell in step #31030. This loop from step #31030 
through step #31035 is repeated until the entire program chain PGC is processed. 

The stream buffer data transfer process of step #31032 is described in further detail below referring to Fig. 70. The 
stream buffer data transfer process (step #31032) comprises steps #31040, #31042, #31044, #31046, and #31048 
shown in the figure. 

At step #31040 it is determined whether the cell is a multi-angle cell. If not. the procedure moves to step #30144. 
At step #31044 the non-multi-angle cell decoding process is executed. 

However, if step #30140 returns YES because the cell is a multi-angle cell, the procedure moves to step #30142 
where the seamless angle change flag SACF is evaluated to determine whether seamless angle reproduction is spec- 
ified. 

If seamless angle reproduction is specified, the seamless multi-angle decoding process is executed in step 
#30146. If seamless angle reproduction is not specified, the non-seamless multi-angle decoding process is executed in 
step #30148. 

The non-multi-angle cell decoding process (step #31044, Fig. 70) is described further below with reference to Fig. 
71. Note that the non-multi-angle cell decoding process (step #31044) comprises the steps #31050, #31052. and 
#31054. 

The first step #31050 evaluates the interleaved allocation flag IAF_reg to determine whether the cell is in an inter- 
leaved block. If it is. the non-multi-angle interleaved block process is executed in step #31052. 

The non-multi-angle interleaved block process (step #31052) processes scene branching and connection where 
seamless connections are specified in. for example, a multi-scene period. 

However, if the cell is not in an interleaved block, the non-multi-angle contiguous block process is executed in step 
#31054. Note that the step #31054 process is the process executed when there is no scene branching or connection. 
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The non-muhi- angle inlei leaved block process (step #31052. Fig. 7i) is described lurther below with reference to 

Fig 72 

At step ^31060 the leading head 2006 is jumped to the first cell VOBU start addiess C_FVOBU_SA read from the 
C_ FVOBU_SA ieg register 

Moie speotically. the addiess data C_ FVOBU_SA_reg stoied in the decoding system controller 2300 (Fig. 26) is 
input as brtstieam reproduction contiol signal St53 1o the i eproduction controller 2002. The reproduction controller 2002 
thus controls the recording media duve unit 2004 and signal piocessoi 2008 to move the reading head 2006 to the 
speolied addiess. data is iead. enoi conection code ECC and othei signal piocessing is accomplished by the signal 
piocessoi ?00S. and the cell start VOBU data is output as the teproduced bitstream St6l to the stream butter 2400. The 

k. procedme then moves to step £31062 

At step *3i062 the DSl packet data in the navigation pack NV (Fig. 20) is extracted in the stream butter 2400, the 
decoding tat*e *s defined, and the procedure moves to step #31064. The registers set in the decoding table are the 
ILVU_EA reg N7_iLVU_SA_reg. VOB_V_SPTM_reg. VOB_V_EPTM_reg. VOB_A_STP_PTM1_reg, 
VOB_A_S7P_PTM?_reg. VOB_ A_G AP LE N 1 _j eg, and VOB_A_GAP_LEN2_reg. 

it Ai step s2 1064 the oaia tiom the iiist cell VOBU start addiess C_FVOBU_SA_jeg to the ILVU end pack address 

ILVU_EA i eg • e Un? data one mtei leaved unit ILVU. is transfer! ed to the stream buffer 2400. The procedure then 
moves to step *3 1 006 

More speoitCAiu tf^e adc*ess cata ILVU_EA_reg stored in the decoding system controller 2300 (Fig. 26) is sup- 
plied to the »cp*ochjcban cxxnioue* PO02 The reproduction controller 2002 thus controls the recording media drive unit 
A' 2004 and s»gnai p»ocei^o» ?OC8 to toac the data to the ILVU_EA_reg address, and after error correction code ECC and 
other signal procet.wog * acco^r*iU^ea b/ the signal processor 2008, the data for the first ILVU in the cell is output as 
the reproduced b*t^t>*»*rr. ^ • tc ttn? stitwm bufier 2400. It is thus possible to output the data for one contiguous inter- 
leaved unit ILVU o*~> r-w • c»rv>g rr*o> m to the stream buffer 2400. 

At step c^iOf^ «i rv-r««-r*rw! ^-u>rw all interleaved units in the interleaved block have been read and trans- 
T5 feued M the mtpfi^-**- n v\i r> or.^sAri is the last ILVU in the interleaved block, "0x7FFFFFFF" indicating termi- 
nation is set to the n**~ il.v ttaii acioe^s rJT_iLVU_SA_reg as the next read address. If all interleaved units in the 
interleaved Week hav* pxr. z~*n processed the procedure moves to step #31068. 

At step *3106£ -ft«y>j ^ ?D06 is again jumped to the addiess NT_ILVU_SA_reg of the next interleave unit 
to be reproduced, and p»oc«x»e k>x>s back to step #31062. Note that this jump is also accomplished as described 
above, and the loop tic*~ u*v iOt>2 to step #31068 is repeated. 

However, rl s:ep ff2tO:*. «eti^ns YES. i.e., all interleaved unit ILVU in the interleaved block have been transferred, 
step Z3 1052 terminates 

The non-muiti -angi** wv»v«j tfock process (step #31052) thus transfers the data of one cell to the stream buffer 

2400. 

:-5 The non-muh»-angw? contiguous block process is executed in step #31054, Fig. 71 , is described further below with 

reference to Fig 73 

At step *3i 0?0 the rtv*jmg head 2006 is jumped to the first cell VOBU start address C_FVOBU_SA read from the 
C_FVOBU_SA_reg ieg«ste Th»s jump ts also accomplished as described above, arid the loop from step #31072 to step 
S3 1076 is initiated 

<o . At step r2i07? the Ubi packet data in the navigation pack NV (Fig. 20) is extracted in the stream buffer 2400, the 
decoding table is de*meo ana the procedure moves to step #31074. The registers set in the decoding table are the 
VOBU_EA_reg. VOE v SHW ieg, VOE_V_EPTM_reg. VOB_A_STP_PTM1_reg. VOB_A_STP_PTM2_reg, 
VOB_A_GAP_LENi _«ey a iv VOB_ A_GAP_LEN2_reg. 

At step ^3 K-74 th* cuia horn the first cell VOBU start address C_FVOBU_SA_reg to the end pack address 
45 VOBU_E A_reg i e . tn* o-ra *> one video object unit VOBU, is transferred to the stream buffer 2400. The procedure 
then moves to step *3 1 0?t lt>* data to» one video object unit VOBU contiguously arrayed to the recording medium M 
can thus be transience to T*e it! earn outlet 2400. 

At step #31076 r. rs 3do»r-»nod whether all cell data has been transferred. If all VOBU in the cell has not been trans- 
ferred, the data tor the nei 4 VOBU is read continuously, and the process loops back to step #31070. 
eo However, if all VOBU data m the cell has been transferred as determined by the C_LVOBU_SA_reg value in step 

#31076, the non-mutti-ang e contiguous block process (step #31054) terminates. This process thus transfers the data 
of one cell to the stream huti« ?400. 

Another method of accomplishing the non-multi-angle cell decoding process (step #31044, Fig. 70) is described 
below with reference to Fic 74 

££ At step #21080 the reacting head 2006 is jumped to the first cell VOBU start address C_FVOBU_SA_reg. and the 

first VOBU data in the cell «s tiansfened to the stream buffer 2400. The piocedure then moves to step #31081. 

At step #31081 the DSi packet data m the navigation pack NV (Fig. 20) is extracted in the stream buffer 2400, the 
decoding table is defined, and the proceoure moves to step #31082. The registers set in the decoding table are the 
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SCR_buffer. VOBU_EA_ieg. ILVUJIao reg. UNH_ END.flag.ieg. ILVU_EA_reg. N1_ ILVU_ SA_ieg. 
VOB_V_SPTM_reg. VOE_V_EPTM_ teg VOB^ A_ STP_PTM1_reg. VOB_ A_ STP_PTM2_teg. 

VOB_A_GAP_LEN1_reg. and VOB_ A_GAP_ LE N2 i eg 

At step #31082 the data from the first cell VOBU start address C_FVOBU_SA_reg to the end pack addiess 
VOBU_EA_reg. i.e.. the data foi one video object unit VOBU. is tianstened to the stream butlei 2400. The procedure 
then moves to step #31083. 

At step #31083 is determined whethei all cell VOBU data has been transferred. H it has. the process (step #31044) 
terminates. If it has not. the proceduie moves to step #31084. 

At step #31084 it is determined whether the VOBU is the last VOBU in the interleaved unit. If not. the process loops 
back to step #31081. If so. the procedure advances to step #31085. It is thus possible to transfer one cell of data in 
VOBU units to the stream buffer 2400. 

The loop from step #31081 to step #31084 repeats as described above. 

At step #31085 it is determined whether the interleaved unit ILVU is the last in the interleaved block. If so. step 
#31044 terminates. If not. the procedure advances to step #31086. 

At step #31086 the reading head 2006 is jumped to the addiess NT_ILVU_SA_reg of the next interleave unit, and 
the procedure loops back to step #31081 . It is thus possible to transfer the data for one cell to the stream buffer 2400. 

The seamless multi-angle decoding process executed in step #30146, Fig. 70. is described below referring to Fig. 

75. 

At step #31090 the reading head 2006 is jumped to the first cell VOBU start address C_FVOBU_SA read from the 
C_FVOBU_SA_reg register, and the first VOBU data in the cell is transferred to the stream buffer 2400. The procedure 
then moves to step #31 091 . This jump is also accomplished as described above, and the loop fr om step #31 091 to step 
#31095 is initiated. 

At step #31091 the DS! packet data in the navigation pack NV (Fig. 20) is extracted in the stream buffer 2400. the 
decoding table is defined, and the procedure moves to step #31092. The registers set in the decoding table are the 
lLVU_EA_reg. SM L_AGL_Cl_DSTA_i eg - SML_AGL_C9_DSTA_reg, VOB_V_SPTM_reg. VOB_V_EPTM_reg. 
VOB_A_STP_PTM1_reg, VOB_A_STP_PTM2_reg. VOB_A_GAP_LEN1_reg. and VOB_A_GAP_LEN2_reg. 

At step #31092 the data from the first cell VOBU start address C_FVOBU_SA_reg to the ILVU end pack address 
ILVU_EA_reg, i.e.. the data for one ILVU. is transferred to the stream buffer 2400. The procedure then moves to step 
#31093. It is thus possible to output the data for one contiguous interleaved unit ILVU on the recording medium M to the 
stream buffer 2400. 

At step #31093 the ANGLE_NO_reg is updated, and the procedure moves to step #31094. This update operation 
resets the ANGLE_NO_reg to the angle number of the angle selected by the user when the user changes the angle 
using the scenario selector 2100 (Fig. 26). 

At step #31094 it is determined whether the angle cell data has all been transferred. If all ILVU in the cell have not 
•been transferred, the procedure moves to step #31095. If all ILVU in the cell have been transferred, the process termi- 
nates. 

At step #31095 the reading head 2006 is jumped to the next angle ( SML_AGL_C#n_reg) , and the process loops 
back to step #31091. Note that SML_AGL_C#n_reg is the address of the angle to which the ANGLE_NO_reg was 
updated in step #31093. 

It is thus possible to transfer the data for the angle selected by the user to the stream buffer 2400 in ILVU units. 
The non-seamless multi-angle decoding process is executed in step #30148, Fig. 70, is described below referring 
to Fig. 65. 

At step #31 100 the reading head 2006 is jumped to the first cell VOBU start address C_FVOBU_SA read from the 
C_FVOBU_SA_reg register, and the first VOBU data in the cell is transferred to the stream buffer 2400. The procedure 
then moves to step #31 101 . This jump is also accomplished as described above, and the loop from step #31101 to step 
#31106 is initiated. 

At step #31 101 the DSI packet data in the navigation pack NV (Fig. 20) is extracted in the stream buffer 2400, the 
decoding table is defined, and the procedure moves to step #31102. The registers set in the decoding table are the 
VOBU_EA_reg, NSML_AGL_Cl_DSTA_reg, NSML_AGL_C9_DSTA_reg, VOB_V_SPTM_reg, VOB_V_EPTM_reg, 
VOB_A_STP_PTM1_reg, VOB_A_STP_PTM2_reg, VOB_A_GAP_LENl_reg, and VOB_A_GAP_LEN2_reg. 

At step #31102 the data from the first cell VOBU start address C_FVOBU_SA_reg to the end pack address 
VOBU_EA_reg, i.e., the data for one VOBU, is transferred to the stream buffer 2400. The procedure then moves to step 
#31 103. It is thus possible to output the data for one contiguous video object unit VOBU on the recording medium M to 
the stream buffer 2400. 

At step #31 103 the ANGLE_NO_reg is updated, and the procedure moves to step #31 104. This update operation 
resets the ANGLE_NO_reg to the angle number of the angle selected by the user when the user changes the angle 
using the scenario selector 2100 (Fig. 26). 

At step #31 104 it is determined whether the angle cell data has ail been transferred. If all VOBU in the cell have not 
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been transferred, the procedure moves to step £ 31 105. li all VOBU in the cell have been transferred, the process ter- 
minates. 

At step #31105 the reading head 2006 is jumped to the next angle (NSML_AGL_C#n_reg). and the process 
advances to step #31 106. Note that NSML_ AGL_Cr?nj eg is the address ot the angle to which the ANGLE_NO_ieg 
5 was updated in step #31 103. 

It is thus possible to transfer the data foi the angle selected by the user to the stream butler 2400 in VOBU units 
Step #31 106 is an effective step tor high speed angle switching, and simply clears the stream buffer 2400. By thus 
clearing the stream buffer 2400 the data for the newly selected angle can be reproduced without reproducing the angle 
data that is still not decoded. In other words, clearing the stream buffer 2400 enables faster response to user opera- 
w tions. 

It is very important that DVD decoder according to the present invention can promptly moves to the next data read- 
ing process and effectively performs the data reading once after the detection ot the end ot data such as interleave unit 
ILVU and video object unit VOBU for the sake ot seamless reproduction which is one of main targets of the present 
invention. 

is With reference to Fig. 66. a construction of the stream buffer 2400 which can performs the end detection of inter- 

leave unit ILVU is described briefly. The stieam butler 2400 comprises a VOB buffer 2402, a system buffer 2404, a nav- 
igation pack extractor 2406, and a data counter 2408. The system buffer 2404 temporarily stores the title control data 
VTSI(Fig. 16) included in signal St61. and outputs a control information St2450 (St63) such as VTS_PGC. 

The VOB buffer 2402 temporarily stores the title VOB data VTSTT_VOB (Fig. 1002). and the stream St67 to the 

20 system decoder 2500. 

The NV (navigation pack) extractor 2406 receives the VOB data at the same time with the VOB buffer 2402, and 
extracts the navigation pack NV therefrom. The NV extractor 2406 furthermore extracts the VOBU final pack address 
COBU_EA or ILVU final pack address ILVU_EA which are the DSI generation information DSI_GI shown in Fig. 19 to 
produce a pack address information St2452 (St63). 

25 The data counter 2408 receives the VOB data at the same time with the VOB buffer 2402. and counts each of pack 

data shown in Fig. 19 byte by bye. Then, the data counter 2408 produces a pack input terminating signal St2454 (St63) 
at the time when the inputting of pack data is completed. 

Due to its construction shown in Fig. 66. the stream buffer 2400 performs the VOBU data transfer as examples at 
step #31064 of Fig. 72, as follows. The stream buffer 2400 outputs the VOBU data for the NV extractor 2406 and data 

so counter 2408 at the same time when the VOBU buffer 2400 receives the VOBI data on the top of interleave unit ILVU. 
As a result, the NV extractor 2406 can extracts the data of ILVU_EA and NTJLVU_SA at the same time with the input- 
ting of navigation pack data NV, and outputs thereof as signal St2452 (St63) to the decode system controller 2300 (Fig. 
26). 

The decode system controller 2300 stores the signal St2452 into the ILVU_EA_reg and NT_ILVU_SA_reg. and 

55 then start to counts the number of packs based on the pack terminating signal 2452 from the data counter 2408. Based 
on the fore mentioned the counted value of packs and ILVU_EA_reg, the decode system controller 2300 detects the 
instance when the inputting of final pack data of ILVU is completed, or the inputting final byte data of the final pack of 
the ILVU is completed. Then, the controller 2300 further give a command for the bitstream reproducer 2000 to move to 
the position having a sector address indicated by NT_ILVU_SA_reg. The bitstream producer 2000 moves to the sector 

40 address indicated NT_ILVU_SA_reg, and starts to read the data. Thus, the detection of final end of ILVU and reading 
process for the next ILVU can be performed effectively. 

In the above, an example where the multimedia data MBS is reproduced by the bitstream reproducer 2000 without 
a buffering process, and is inputted to the stream buffer 2499. However, in the case that the signal processor 2008 of 
the bitstream reproducer 2000 is incorporated with a buffer for error correction process, for example, the controller 2300 

<5 gives a moving command to reproducer 2000 so that the reproducer 2000 moves to the reading position indicated by 
NTJLVU_SA_reg after completion of the final pack data of fore mentioned ILVU and clearing the internal buffer of the 
reproducer 2000. Thus, the effective reproduction of ILVU data even when the bitstream reproducer 2000 includes a 
buffer for error correction code (ECC) process. 

Furthermore, when the bitstream producer 2000 has a buffer for ECC process, the data can be transferred effec- 

bo tively by providing any means having a function equivalent to that of data counter 2408 (Fig. 66). In other words, the 
bitstream reproducer 2000 generates the pack input completion signal St62; the decode system controller 2300 gives 
a command based on the signal St62 the bitstream reproducer 200 to move to the reading position having sector 
address designated by NT_1LVU_SA_reg. As apparent from the above, the data can be transferred effectively even 
when the bitstream reproducer 2000 has a function to buffer the data reproduced from the recording media M. 

££ It is to be noted that the apparatus and method substantially the same as those described in the above with respect 

to the interleave unit ILVU can be used for the detection VOBU end. In other words, by replacing the extraction of 
ILVU_EA and NT_ILVU_Sa, and the storing of ILVU_EA_reg and NTJLVU_SA_reg with the extraction of VOBU_EA 
and storing VOBU_EA_reg, the apparatus and method according to the present invention, described above, can be 
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used tc»i the- deieciion o1 an_<S>end This is effective Ioj the VOBU data tianstei i mg opeiations shown at steps #31074, 
#3108?. -31092. and #31 102. 

Thus, the leading ol data such as ILVU and VOBU can be performed effectively 

Decoding flows m the stieam bulle t 

The pfocess tor decoding data in the stieam butler 2400 shown as step #31034 in Fig. 64 is described below refer- 
nng to Fig 67 Th.s process (step #31034) comprises steps #31110. #31 1 12. #31114. and #31116. 

At step *3n 10 data is translened in pack units fiom the stream butlei 2400 to the system decoder 2500 (Fig. 26). 
The procedure then moves to step #31112 

At step *3n 12 the pack data is tiom the stieam butler 2400 to each ot the butters, i.e.. the video buffer 2600, sub- 
piciute butter 2700. and audio butler 2800 

At step *31 1 "2 me ids of the user-selected audio and sub-picture data. i.e.. the audio ID AUDICMD_reg and the 
sub-picture ID SP_ ID ieg stored to the scenario information register shown in Fig. 62, aie compared with the stream 
ID and sub- stieam ID redd iiom the packet header (Fig. 19). and the matching packets are output to the respective buff- 
ers The procedure thtm nxjves to step #3n 14. 

The decode :m>ng of me lespective decoders (video, sub-picture, and audio decoders) is controlled in step 
*31 1 14. i e . the cecodmg operations of the decoders are synchronized, and the procedure moves to step #31 116. 

Note that me dccoOe* *-yncnr creation process of step #31 114 is described below with reference to Fig. 68. 

The respective e*o*~x^ar * sir^gc are then decoded at step #31116. The video decoder 3801 thus reads and 
decodes the data from tr»« v^ooo tx/fte* m« suo-piciure decoder 3100 reads and decodes the data from the sub-picture 
buffer, and the audio o©coc«- ~*?OC and decodes the data from the audio buffer. 

This stream butte* c-u. o««:c»*og process men terminates when these decoding processes are completed. 

The decoder syncnmn.-rrir r*"*'*^ o* vi pp #31 1 14, Fig. 67, is described below with reference to Fig. 68. This 
processes comprises st*r» 1 1 ?C *m i ?? and #31 124. 

At step £31 120 r t ts cv?-*«rr*n*<3 «^»^tr>e< a seamless connection is specified between the current -cell and the pre- 
ceding cell If a searmess connecaon xr%e p> ocedur e moves to step #3 1 1 22 . if not. the procedure moves to step #3 1 1 24 . 

A process synch? 00:03 cc** at>y> t> o» oducmg seamless connections is executed in step #311 22, and a process 
synchronizing operation to nor 1 * S4*<am»<~>s connections is executed in step #3 11 24. 

By means of me pi esem mvermon thus described it is possible to read and supply to a decoder the source data for 
plural vioeo objects without «nte»iuc?torts m the data during reproduction. When reproducing plural videoobjects of the 
same length, it is also possO* to seamlessly reproduce the video objects without intermitting the data or the presenta- 
tion time even from a m»3oo«nt m a voeo oOject. 

It is also possible to sux>> tr* data of plur al video objects to the decoder without intermitting the data during pres- 
entation Plural video obiets can arse be reproduced by reading only the necessary information and seamlessly switch- 
ing the presented video object w*?rxxrt inter mining the data during presentation. 

Switching between plural voeo objects can also be accomplished at high speed even while presentation is in proc- 
ess Furthermore, it is possi>e to dynamically switch to another system stream according to a user selection even while 
in the middle of video ooieo p-esentation when reproducing data from an optical disk, and these dynamic system 
stream changes can be e«ecu*eo seamlessly. 

Industrial Applicability 

As is apparent from a n>rtrx>3 and an apparatus according to the present invention for interleaving a bitstream to 
record the interleaved bitstream to a recording medium and reproduce the recorded bitstream therefrom is suitable for 
the application of an authoring sr*te*n wntcn can generate a new title by editing a title constructed by bitstr earns carry- 
ing various information m accooarv:o with me user s request, and is also suitable tor a Digital Video Disk System, or 
DVD System being developed »ece«rjy 

Claims 

1. An interleaving method tor operating a bitstream from plural video objects (VOB) containing compressed video 
data by arranging in the presentation order, wherein 

interleaved data blocks (bkx* 4. block 6) in which plural video objects (VOE) are contiguously arrayed using inter- 
leaved units (ILVU) each longer than the shortest read time (ILVUMT) such that the video object presentation start 
and end points are aliened ne ratio (equation 6) between the presentation times of video objects (VOB) with the 
shortest presentation time and video objects (VOB} other than those with the shortest presentation time is within a 
range obtained from the shortest read time (ILVUMT). the maximum jumpable distance (JM), and the smallest con- 
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Hoi unit VOBU. and contiguous data blocks (blocks l. 2. 3. 5. 7) wherein the presentation start points and end 
points ot the video objects (VOB) arrayed therein are not aligned. 

2. An interleaving method that is a lecoiding method toi an optical disk (M) to which pluial video objects (VOB) con- 
i tainmg compiessed video data ate lecoided by contiguously anaying plural video objects (VOB) having the same 

piesentation time with the piesentation start and end points aligned using interleave units (ILVU) ol which the 
boundary posilions are the same between video objects (VOB) and which have a length greater than the shortest 
lead time(ILVUMT). 

ro 3. An interleaving method according to Claim 1 and Claim 3 wherein the shortest read time (ILVUMT) is greater than 
the shortest piesentation time, said shortest piesentation time being obtained Horn information including the repro- 
duction bit rate (Vo) ot the data contained in the interleave units, the data lead bit rate (Vr) ot the reproduction appa- 
ratus, and the jump pertoimance. and is an integer multiple ol the smallest control unit (VOBU). 

75 4. An mtei leaving method according to Claim 1 wheiein said ratio is obtained from a compensated value adding the 
sho* test read time (ILVUMT) and the smallest control unit (VOBU). and a compensated value reducing the smallest 
control unit (VOBU) by the maximum jumpable distance (JM). 

5. An me» leaving method according to Claim 3 and Claim 4 wherein the smallest control unit (VOBU) is a GOP video 
20 ccKnp«ec^on unrt within the range Horn 0.4 sec. to 1.0 sec. or less. 

6. a on.tr earn generated from plural video objects (VOB) containing compressed video data, and characterized by a 
«.& L#rtu- * anangmg m the presentation order interleaved data blocks (block 4, block 6) in which plural video objects 

cnrrtir^icusly arrayed using interleaved units (ILVU) each longer than the shortest read time (ILVUMT) 
25 ?ajrf> m-*t vrw*: object presentation start and end points are aligned, and the ratio (equation 6) between the 

jv*-.4»ot*bDn nrnes. oi video objects (VOB) with the shortest presentation time and video objects (VOB) other than 
rx.>v* «>rioiiesi presentation time is within a range obtained Horn the shortest read time (ILVUMT). the max- 

i-r-\>at*e 3rv.ance (JM). and the smallest control unit VOBU. and contiguous data blocks (blocks 1. 2. 3. 5. 
- it <~-entation start points and end points of the video objects (VOB) arrayed therein are not aligned. 

50 

7. A.- ci^<* '-cc*a»ng medium (M) for recording a bitstream generated from plural video objects (VOB) contain- 
*> ; _o»-x • .-«"o oa:a. wherein interleaved data blocks (block 4, block 6) in which plural video objects (VOB) 

:ttr*.}jouv» a"a,ed using interleaved units (ILVU) each longer than the shortest read time (ILVUMT) such that 
rv x -* *~c r> ^^ntation start and end points are aligned, and the ratio (equation 6) between the presentation 
5E rm*~ vo« otjw-cfc. ;V0B) with the shortest presentation time and video objects (VOB) other than those with the 

vro c» eve*xa!»r-. t me is within a range obtained from the shortest read time (ILVUMT), the maximum jumpable 
cjotanc* \ JM; arc tr* smallest control unit VOBU. and contiguous data blocks (blocks 1. 2, 3, 5, 7) wherein the 
t*ev«^iatJon staM ror-ts and end points of the video objects (VOB) arrayed therein are not aligned, are arranged 

40 

8. Ar. oprc^i or> > *coo»ng medium (M) comprising an interleaved recording region for recording plural video objects 
< VOB} confining cxmpressed video data by contiguously arraying plural video objects (VOB) having the same 
p*tr.*«f ltdtiun \tn-*> mtv the presentation stait and end points aligned using interleave units (ILVU) of which the 
oou-xia* y pcnptori^ at* the same between video objects (VOB) and which have £ length greater than the shortest 

<?£ read time (ILVUMT 

9. An optical disk recoomg medium (M) according to claim 7 and Claim 8 wherein the shortest read time (ILVUMT) is 
greater than the sr>onect presentation time, said shortest presentation time being obtained from information includ- 
ing the reproduction bit rate (Vo) of the data contained in the interleave units, the data read bit rate (Vr) of the repro- 

50 ductron apparatus, and the jump performance, and is an integer multiple of the smallest control unit (VOBU)- 

10. An optical disk recording medium (M) according to Claim 7 wherein said ratio is obtained from a compensated 
value adding the shortest read time (ILVUMT) and the smallest control unit (VOBU), and a compensated value 
reducing the smallest control unit (VOB) by the maximum jumpable distance (JM). 

1 1 . An optical disk recording medium (M) according to Claim 9 and Claim 10 wherein the smallest control unit (VOBU) 
is a GOP video compression unit within the range from 0.4 sec. to 1 .0 sec. or less. 
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12. An optical disk recording medium (M) foi recording pluial video objects (VOB) containing compiessed video data 
wherein the interleaved recording legion (block 4. block 6) containing plural video objects (VOB) ol which the pies- 
entation start and end points aie aligned contains in addition to the video data, management blocks (NV) at the 
smallest control unit (VOBU) interval required loi the video data piesentation time, said management blocks (NV) 
containing the end address inloimation (ILVU_EA) of the contiguously readable data unit, and the start addiess 
information (ILVU_SA) ol the next data unit repioduced contiguously thereafter, said addiess information being 
positions on the optical disk r ecording medium (M). 

13. An optical disk recording medium (M) ioi lecoidmg pluial video objects (VOB) containing compiessed video data 
wherein the interleaved recording region (block 4. block 6) containing plural video objects (VOB) of which the pres- 
entation start and end points are aligned contains, in addition to the video data, management blocks (NV) at the 
smallest control unit (VOBU) interval required tor the video data presentation time, said management blocks (NV) 
containing the end address information (ILVU_EA) ol the contiguously readable data unit, and the start address 
information (SML_AGL_C#1-9_DSTA) of plural data units that can be reproduced contiguously thereafter, said 
address information being positions on the optical disk lecoiding medium (M). 

14. An optical disk recording medium (M) according to Claim 12 wherein the location of the management block (NV) is 
the same in plural video objects (VOB). 

15. An optical disk recording medium (M) for recording plural video objects (VOB) containing compressed video data 
wherein the interleaved recording region (block 4, block 6) containing plural video objects (VOB) of which the pres- 
entation start and end points are aligned contains, in addition to the video data, management blocks (NV) at the 
smallest control unit (VOBU) interval required for the video data presentation time, said management blocks (NV) 
containing the end address information (ILVU_EA) of the contiguously readable data unit, and the start address 
information (NSML_AGL_C#1-9_DSTA) of plural data units with a presentation start time near the presentation 
time of the contiguously readable data unit, said address information being positions on the optical disk recording 
medium (M). 

16. An optical disk recording medium (M) according to Claim 11, Claim 12. and Claim 14 wherein the smallest control 
unit (VOBU) is a GOP video compression unit within the range from 0.4 sec. to 1 .0 sec. or less. 

17. An optical disk recording medium reproduction apparatus (DCD) for an optical disk recording medium (M) to the 
interleaved recording region (block 4. block 6) of which are recorded plural video objects (VOB) containing at least 
compressed video data of which the presentation start and end points are aligned, and management blocks (NV) 
recorded in addition to the video data at the smallest control unit (VOBU) interval required for the video data pres- 
entation time, said management blocks (NV) containing the end address information (ILVU_EA) of the contiguously 
readable data units, and the location on disk of the start position of the next contiguously reproducible data unit in 
the presentation sequence, comprising: 

a means for reading at least the information in the management blocks (NV), 

a means for reading the data to the end address based on said end address information (ILVU_EA), 
buffer memory for storing the read position information, and 

a means for reading the next contiguously readable data in the presentation sequence. 

18. An optical disk recording medium reproduction apparatus (DCD) for an optical disk recording medium (M) to the 
interleaved recording region (block 4, block 6) of which are recorded plural video objects (VOB) containing com- 
pressed video data of which the presentation start and end points are aligned, and management blocks (NV) 
recorded in addition to the video data at the smallest control unit (VOBU) interval required for the video data pres- 
entation time, said management blocks (NV) containing the end address information (ILVU_EA) of the contiguously 
readable data units, and the locations on disk of the start position of the plural data units, comprising: 

a means for reading (2400) the information in the management blocks (NV). 

a means for reading the data to the end address based on said end address information (ILVU_E A), 

buffer memory (2400) for storing the read data. 

a means (St65) for clearing said buffer, 

a means (2100) for selecting one of said plural data units, and 

a means for reading the address information of the start position of the data selected using said selection 
means (2100). 
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19. An interleaving method which tor the presentation ol a bitstream that is reproduced by selecting two oi more data 
units (VOB) Irom a bit stream compi ising thi ee or more data units (VOB) contiguous on the same time-base is chat - 
aderized by generating said bitstream by arranging the selected data units (VOB) in a particular sequence on the 
same time-base based on the presentation time ot each data unit (VOB) so that it is possible to sequentially access 
all data units (VOB) and present only the selected data units (VOB) without time-base inter mitt ence 

20. An interleaving method which tor the presentation ot a bitstream that is reproduced by selecting two or more data 
units (VOB) fr om a bit stream compi ising three or more data units (VOB) contiguous on the same time-base is char - 
aderized by generating said bitstream by arranging the selected data units (VOB) in a particular sequence on the 
same time-base based on the presentation time ot each data unit (VOB) so that it is possible to access and present 
without time-base intermittence only the selected data units. 

21. An encoding means (ECD) used in a digital video disk system whereby plural source signals are encoded, a bit- 
stream comprising three or more compressed data units (VOB) contiguous on the same time-base is generated, 
and two or more data units (VOB) are selected Irom said bitstieam. expanded, and lepioduced. 
characterized by generating said bitstieam by arranging the selected data unit (VOB) in a particular sequence on 
the same time-base based on the presentation time ol each data unit (VOB) so that it is possible to sequentially 
access all data units (VOB) and present only the selected data units (VOB) without time-base intermittence. 

22. A decoding means (DCD) used in a digital video disk system whereby plural source signals are encoded, a bit- 
stream comprising three or more compressed data units (VOB) contiguous on the same time-base is generated, 
and two or more data units (VOB) are selected Irom said bitstieam. expanded, and reproduced, characterized by 
sequentially accessing all data units (VOB) and presenting only the selected data units (VOB) without time-base 
intermittence. 

23. A digital video disk system comprising: an encoding means (ECD) for encoding plural source signals and generat- 
ing a bitstream comprising three ot more compressed data units (VOB) contiguous on the same time-base, and a 
decoding means (DCD) tor selecting, expanding, and reproducing two or more data units (VOB) Irom said bit- 
stream, wherein said encoding means (ECD) generates said bitstream by arranging the selected data units (VOB) 
in a particular sequence on the same time-base based on the presentation time ol each data unit (VOB) so that the 
decoding means (DCD) can access all data units (VOB) and reproduce the selected data units (VOB) without time- 
base intermittence. 

24. An optical disk (M) that is used in a digital video disk system comprising an encoding means (ECD) lor encoding 
plural source signals and generating a bitstream comprising three or more compressed data units (VOB) contigu- 
ous on the same time-base, and a decoding means (DCD) for selecting, expanding, and reproducing two or more 
data units (VOB) from said bitstream. comprising: a recording region (TRA) for contiguously recording said bit- 
stream by means of arranging said data units (VOB) in a particular sequence on the same time-base based on the 
presentation time ol each data unit (VOB) so that the selected data units (VOB) can be continuously accessed at a 
particular time interval (Tj) tor contiguous reproduction without time-base intermittence. 
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~ 1 834 Based on A_BR, set A_RATE 



£1836 



Based on VOB_V_KIND, set Pull-down 
detection mode 



S 1 838 Based on VOB_A_KIND, set A_ENCMD 



~ 1840 



Set V ENDST and V INST 



£ 1842 



1844 



Set preceding VOB_NO as preceding 
B VOB NO when VOB Fsb=1 



Set following VOB_NO as following 
F VOB NO 



c 



END 
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Extract VOBS_NO and VOB_NO 
according to reproduction order 



Based on ILV_BR, set V_MRATE 



ILVU MT extraction 



Set GOPST ( N=15, M=3) 
GOP_FXflag=1 



Set GOPST as closed GOP 



I 



VOB data setting routine 



c 



END 
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Extract VOBS_NO and VOB_NO 
according to reproduction order 



Based on ILV_BR, set V_MRATE 



Extraction of ILV DIV 



VOB data setting routine 
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END 
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NO 
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Multi-angle 


sub-routine 


under non-seamless 


switching control ! 




Parental lock 
sub-routine 



#2324 



Multi-angle sub-routine 
under seamless 
switching control 



#2328 



Recording of C_PBI 



#2330 . 

All VOB 
^sets are processed. 
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= 2352 
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c 



START 



CBM — 01 .10 or 11 



CBT — 01 
I 



SPF — 1 



STCDF — 1 



IAF — 1 



j 



Divide VOBU into interleave units greater than 
ILVU MT for a VOBU 



T 



Arrange interleave unit in angle cell sequence 



Recording of VOBU_EA 



I 



Recording of C_FVOB_SA and C_LVOBU_SA 



I 



Recoding of NSML_AGL_C1_DSTA~ 
NSML AGL C9 DSTA 



I 



Write 7FFFFFFFh to NSML AGL Cn DSTA 



c 



END 
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START 
I 



CBM — 01.10 or 11 



CBT — 01 



SPF 1 
I 



STCDF — 1 
I 



IAF — 1 



Divide VOBU into ILVU units greater than 
ILVU MT for a VOBU 



I 



Arrange interleave units in angle cell 
sequence 



Recording of VOBU_EA 



Recording of C_FVOB_SA and C_LVOBU_SA 



Recording of VOBU_EA 



Recordino of SML_AGL_C1_DSTA~ 
SML AGL C9 DSTA 



I 



Write FFFFFFFFh to SML AGL Cn DSTA 
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END 
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START 



J 



CBM *- 01,10 or 11 



SPF — 1 



I 



STCDF — 1 



I 



IAF — 1 



Divide each VOB into ILVUs 



Arrange ILVU and VOBU for each cell 
in numeric order 



Recording of VOBU_EA 



Recording of 
C FVOBU SA and C LVOBU SA 



Recording of ILVU_EA 



Recording of NT_ILVU_SA 



I 



Recoding of ILVUflag= ,, V 



Recording of UnitEndflag="r 



Write FFFFFFFFh to NT ILVU SA 
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END 
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f START j 



CBM — 01,10 or 11 



IAF — 1 



I 



Arrangement of VOBU 



Recording of 
VOBU_EA 

I 



Recording of 
C_FVOBU_SA and 
C LVOBU SA 
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END 
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START 
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Extract VOBS_NO and VOB_NO 
according to reproduction order 



Setting of V_MRATE 



VOB data setting routine 
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END 
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N.A.N.A. 1 (NSML AGL Cl_DSTA_reg) 



N.A.N. A. 2 (NSML_AGL C2_DSTA_reg) 



N.A.N.A. 3 ( NS M L_AG L_C3_D STA_reg ) 



N.A.N.A. 4 (NSML_AGL_C4_DSTA_reg) 



N.A.N.A. 5 (NSML_AGL C5_DSTA_reg) 



N.A.N.A. 6 (NSML_.AGL_C6 DSTA_reg) 



N.A.N.A. 7 (NSML_AGL _C7_DSTA_reg) 



N.A.N.A. 8 (NSML_AGL_C8_DSTA_reg) 



N.A.N.A. 9 (NSML_AGL C9 DSTA__reg) 



Register Name 



Register Name 



CO 

<£ 2 
co co c 

0) ® o 

- £ ffl 

o cd cn 
~ en c: 

hi 



S.A.S.A. 1 (SML_AGL_C1_ DSTA_reg) 



S.A.S.A. 2 (SML_AGL_C2_DSTA_reg) 



S.A.S.A. 3 (SML_AGL_C3_DSTA_reg) 



S.A.S.A. 4 (SML_AGL_C4_DSTA_reg) 



S.A.S.A. 5 (SML_AGL_C5_DSTA_reg) 



S.A.S.A. 6 (SML_AGL_C6__DSTA_reg) 



S.A.S.A. 7 (SML AGL _C7 DSTA reg) 



S.A.S.A. 8 (SML_AGL_C8_DSTA_reg) 



S.A.S.A. 9 (SML_AGL_C9_DSTA_reg) 



VOBU info 
Register 



Register Name 



VOBU final address (VOBU_EA_reg) 
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Register Name 


Value 


Interleave unit flag 

(ILVU_flag_reg) 


ILVU: VOBU is in ILVU 


N ILVU: VOBU is not in ILVU 


Unit end flag 

(UNIT_END_flag_reg) 


END: At the end of ILVU 


N END: Not at the end of ILVU 


Final pack address of ILVU (ILVU EA reg) 



Starting address of next ILVU (NT ILVU SA_reg) 



I. V. F. P. S. T. (VOB_V_SPTM_reg) 
F. V. F. P. T. T. (VOB_V_EPTM_reg) 



Audio reproduction stopping time 1 (VQB A GAP PTM1_reg) 

Audio reproduction stopping time 2 (VOB_A GAP_PTM2_reg) 

Audio reproduction stopping period 1 (VQB A GAP LEN1 reg) 

Audio reproduction stopping period 2 (VQB A_GAP LEN2_reg) 
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-3-030 



Set decoding 
system table 



r 3-032 



Data transfer to 
stream buffer 



^31035 



YES 



#31034 



l 



Decode data in 
stream buffer 



T 
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#31048 

^31 100 



Jump to C_FVOBU_SA_reg 



#31101 



Setting of decode table 
VOBU_EA_reg, 
NSML_AGL_Cl_DSTA_reg — 
NSM L_AGL_C9_DSTA_reg , 
VOB_V_SPTM_reg, 
VOB_V_EPTM_reg, 
VOB_A_STP_PTMl_reg, 
VOB_A_GAP_LENl_reg, 
VOB_A_STP_PTM2_reg, 
VOB_A_GAP_LEN2_reg, 

# 31102 | 

Transfer VOBU data, designated by 
VOBU_EA_reg, to stream buffer 

#31103 



Update ANGLE_NO_reg 
n=ANGLE_NO_reg 




Jump to NSML_AGL_C#n_reg 



#31106 

Clear stream buffer 



114 



EPO 847 1 98 A1 



Fig. 66 



S:61 



2400 



1 



2402 

S 



VOB buffer 
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Data counter 



NV extractor 
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System buffer 
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Data transfer from 
stream buffer to 
system decoder 


331112 




#. 


System decoding 


31114 




Decoders 
synchronization 


31116 




Decoding of 
elementary stream 
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Synchronization process 
for non-seamless 
connection 



Synchronization process 
for seamless 
connection 
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( START 



£ 3 10202 



# 3 10204 



£ 31 0206 



4? 31 0208 



310210 




Extraction of VTS 
from VMG 



Extraction 


of 


VTSM_C_ 


ADT 







Extract VTSM_VOBS 
and display Title and Menu 



£310212 



£310214 



£310216 




NO 



Extract VTS_PGCl£i for 
Selected Title No. 



Reproduction extracted 
PGC 



C 



END 



118 



EPO 847 1 98 A1 



CO 

o 

cr> 
4* 



CO 

o 

CO 

4* 




o 

CO 

44 



CO 

is 

0) -E 

b o 
ro o 

CD CD 
to ~D 

03 



CD 




O) 


in 


c 


CO 


rc 


<D 




o 




O 


mu 


Q. 
05 


CO 


C 


les 


odi 


earn 


dec 


CO 







to 


<D 


to 


angl 


roce 




CL 






3 




E 


din 


c 


o 


o 


o 




de 



119 



EP0 847 198 A1 



Fig.71 



#31044 



#31050 

IAF jeg =ILVB 
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YES 
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Non-multi-angled 




Non-multi-angled 


interleave process 




contiguous block process 
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#31060 





Jump to C_FVOBU_SA_reg 








#31062 



Set decoding table 
ILVU_EA_reg, NT_ILVU_SA_reg, 
VOB_V_SPTM_reg, 
VOB_V_EPTM_reg, 
VOB_A_STP_PTM1_reg, 
VO B_ A_G AP_LEN1_reg, 
VOB_A_STP_PTM2_reg, 
VOB_A_GAP_LEN2_reg) 



#31064 



Transfer VOBU data, designated by 
ILVU_EA_reg, to stream buffer 




Jump to NT_LVOBU_SA_reg 
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Jump to C_FVOBU_SA_reg 
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<= 



Setting of decode table 
(VOBU_EA_reg, 
VOB_V_SPTM_reg, 
VOB_V_EPTM_reg, 
VOB_A_STP_PTM 1 _reg , 
VOB_A_GAP_LEN1_reg, 
VOB_A_STP_PTM2_reg, 
VOB_A_GAP_LEN2_reg.) 
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Transfer VOBU data, designated by 
VOBU_EA_reg, to stream buffer 
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Jump to C_FVOBU_SA_reg 



Setting of decode table 
SCR_buf1er,VOBU_EA_reg, 
ILU_flag_reg, 
UNIT_END_flag, ILVU_EA_reg, 
NT_ILVU_SA_reg. 
VOB_V_SPTM_reg, 
VOB_V_EPTM_reg, 
VOB_A_STP_PTMl_reg, 
VOB_A_G APLEN 1 _reg , 
VOB_A_STP_PTM2_reg, 
VOB_A_GAP_LEN2_reg 



Transfer VOBU data, designated by 
VOBU_EA_reg, to stream buffer 
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NO 



Transfer 
of data designated by 
C_LVOBU_SA_reg, 
^completed ? 

NO 



ILVU_flag_reg= = ILVU &~ 
UNIT_END_flag_reg= = 
END ? 



YES 
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NT_ILVU_SA_reg= 
0X7FFFFFFF 

9 





NO 


Jump to NT_ 


ILVU_SA_reg 



YES 
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Jump to C_FVOBU_SA_reg 
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Setting of decode table 
ILVU_EA_reg, 
SM L_AG L_C 1 _DSTA_reg ~ 
S M L_AG L_C9_DSTA_reg , 
VOB_V_SPTM_reg, 
VOB_V_EPTM_reg, 
VOB_A_STP_PTMl_reg, 
VOB_A_GAP_LEN1_reg, 
VOB_A_STP_PTM2_reg, 
VOB_A_GAP_LEN2_reg, 
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Transfer VOBU data, designated by 
ILVU_EA_reg, to stream buffer 
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Update ANGLE_NO_reg 
n=ANGLE_NO_reg 
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Jump to SML_AGL_C4f n_reg 
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